Bannon could still ask the full bench of the D.C. Circuit to hear his case or petition the Supreme Court for a review.