"The public must have insight into the operations of the Department of Government Efficiency," the watchdog group's executive director said.