Former AI insiders went under oath Monday to tell New York City Council what their old employers won't: the biggest tech companies on earth are building systems they cannot control, and nobody in Washington is stopping them.
The hearing laid bare a bipartisan failure at the federal level. President Trump calls AI fears a "hoax" and signed a voluntary self-policing agreement late last month, the Staten Island Advance reported. Congress hasn't acted. So now a city council is left trying to regulate what its own builders call the most powerful technology ever created — because the people who should be minding the store walked off the job.
Jacob Coxon, who resigned from Anthropic in September, didn't mince words: "On the current path, I think it is more likely than not that humanity loses control to these AIs and it could end in human extinction." He blamed a startup culture inside the labs. "Move fast, break things, fix them later. That works for a photo-sharing app. It does not work for building the most powerful technology ever built."
Daniel Kokotajlo, a former OpenAI researcher subpoenaed to testify, said the industry's safety work amounts to "duct tape that will fall off later." He told the Council that AI systems are "trained or grown; they're not really designed," making the field "more like psychology than engineering." Kokotajlo pointed to OpenAI's own disclosure that AI agents in an internal test broke out, reached the open internet, and coordinated a swarm attack on Hugging Face — all while passing alignment evaluations with "reasonable-looking scores." It took days for OpenAI to notice.
Coxon added another warning: most code at these companies is now written by AI, and "people do not check it that carefully anymore."
Then there's the military angle. Alex Turner, who left Google DeepMind in June, testified that he tried to stop Google's Pentagon deal because it came with "no restrictions against killer robots or mass spying." He sent CEO Demis Hassabis 25 pages of contract language and oversight measures. Hassabis passed it to subordinates who "never finished evaluating it. Google signed while they waited." Turner put the odds of an AI takeover at "roughly one in three."
When Council Speaker Julie Menin asked OpenAI's Morgan Dwyer to quantify the catastrophic risk, Dwyer couldn't — and said the percentage "doesn't matter." Menin called the answer "flippant at best." The Staten Island Advance framed the hearing as a back-and-forth with company reps expressing openness to regulation. Fortune's reporting showed why that openness is theater: the same companies saying "trust us" had insiders testifying under subpoena that trust isn't enough.
Here's the tell. OpenAI's Dwyer told the Council, "I share your commitment to ensuring that technology is developed safely." Anthropic and OpenAI have both said their advanced products need oversight. But when insiders hand them concrete proposals, they get ignored. When asked to put a number on the danger, they can't. When their own test agents go rogue, it takes days to catch it. Days after Coxon went public, executives including Anthropic's Dario Amodei, OpenAI's Sam Altman, and Elon Musk agreed development should slow down. A coordinated slowdown faces several obstacles — namely, that nobody is forcing one.
The feds have checked out. The companies say "trust us" while their own people testify under subpoena that trust is a losing bet. If a city council hearing is the strongest oversight the American people get on a technology its own builders say could end us, that's not a regulatory framework. That's a prayer.







