"They're worried about the migrants more than they're worried about the U.S. citizens ... It's not fair to anybody"