"They took over, I know the building very well, they took over a building. That is -- that is a big deal," the former president said.