Barriers were erected in front of the ritzy Midtown Manhattan office building where a crazed gunman killed four people Monday, with access being restricted even to some who work there.