"I did not come from a family that gave me a $200,000 allowance every year beginning at the age of 3," he said Saturday at Brooklyn College.