As the IRS fired thousands of workers across the country on Thursday, many laid-off employees walked out of the headquarters in Washington, D.C., for the last time.