Thousands of people fled their homes as a brush fire in the Pacific Palisades quickly spread to 2,921 acres Tuesday, a blaze authorities said could grow further as even stronger winds are expected through the night.