Former researchers and tech executives warn New York City Council of AI extinction risks
Former artificial intelligence researchers and Big Tech executives testified before the New York City Council, warning lawmakers that the uncontrolled race to build advanced systems poses existential dangers to humanity.
During a New York City Council hearing on artificial intelligence safety, former industry researchers and leaders from Anthropic, OpenAI, Google, and Meta testified under oath about the potential perils of frontier models. Jacob Coxon, a former researcher at Anthropic and OpenAI, told lawmakers that society does not yet know how to control any AI system and warned that emergency kill switches will not suffice. Coxon testified that it is more likely than not that humanity will lose control of the technology, warning that AI's current trajectory could end in human extinction.[1][2][4][5][6][10]
Coxon, who resigned from Anthropic the previous month while accusing frontier labs of gambling with human lives, said companies are acting extremely recklessly given the stakes. Coxon and former OpenAI researcher Daniel Kokotajlo also told council members that AI software is increasingly being used to build subsequent AI systems while human researchers check that work less frequently. According to Coxon, the solution is not halting AI development outright, but ensuring safety guardrails function effectively before control is lost.[6][7][8][9][10][11]
The testimony brought broader warnings of misaligned artificial intelligence. Alex Turner, a former researcher at Google DeepMind, cautioned lawmakers that the AI industry is racing to build and grow its own domestic adversary that could one day surpass the threat posed by rival nations like China. In a release reported by CNBC, New York City Council Speaker Julie Menin stated that the hearing aimed to examine these risks under oath and explore municipal legislative solutions.[2][3][12]
Key facts
- Jacob Coxon told New York City lawmakers that humanity does not yet know how to control any AI system and that kill switches will not be enough.
- Coxon warned the New York City Council that it is more likely than not humanity loses control to AI, adding that the current trajectory could end in human extinction.
- Senior executives and representatives from Anthropic, OpenAI, Google, and Meta testified under oath before the New York City Council on AI risks.
- Coxon and former OpenAI researcher Daniel Kokotajlo testified that AI is performing more of the work of developing AI while human researchers inspect it less often.
- Coxon resigned from Anthropic the month prior, accusing Anthropic and OpenAI of gambling with people's lives.
- Former Google DeepMind researcher Alex Turner warned that labs are racing to build their own adversary at home in the form of misaligned AI.
- New York City Council Speaker Julie Menin stated companies would be asked under oath to explain AI dangers and discuss legislative remedies.
Sources · 11 sources
- PO
Polymarket@PolymarketPost on X ·
JUST IN: Ex-Anthropic researcher Jacob Coxon tells NYC lawmakers “we do not know how to control any AI system yet,” warning AI kill switches won’t be enough.
Open source - QU
Quartz@qzPost on X ·
AI Execs Warn NYC: Extinction Risk Is Real Senior leaders from Anthropic, OpenAI, Google, and Meta testified under oath before the New York City Council, with one whistleblower stating it is "more likely than not" https://t.co/5n8dWK9qi4 #AISafety #NYCCouncil #AIExtinctionRisk https://t.co/v2VB5Q7fEF
Open source - MT
MTS@MTSlivePost on X ·
SITUATION EXPLAINED: An ex-DeepMind researcher told New York that misaligned AI is a bigger threat than China. • Alex Turner, formerly of Google DeepMind, testified at the New York City Council hearing on the safety risks of frontier models • "China is not our only potential adversary. With reasonably high chance we are racing to build and grow our own adversary here at home, which is misaligned AI" • "Misaligned AI is everyone's adversary, including our own, and may one day be more powerful than China" @theojaffee: "I beg people to broaden their minds, broaden their horizons, and stop thinking of this tech in rather parochial ways."
Open source - QU
Quartz@qzPost on X ·
Big Tech's own insiders told NYC lawmakers AI could end humanity Anthropic, OpenAI, Google, and Meta executives testified under oath before the New York City Council — and the warnings were stark: former researchers said misaligned AI poses #AISafety #AIHearing #ExistentialRisk https://t.co/ZF69F4Lvkp
Open source - TE
Techmeme@TechmemePost on X ·
Former Anthropic researcher Jacob Coxon and representatives from Anthropic, Google, OpenAI, and Meta testified at a New York City Council hearing on AI safety (Bloomberg) (Visit Techmeme dot com for the link and full context!)
Open source - LD
Lark Davis@LarkDavisPost on X ·
"It could end in human extinction." That was the warning from former Anthropic/OpenAI researcher Jacob Coxon at an NYC Council hearing. He laid out two paths: catastrophic collapse, or a future where it makes everyone's life better. The AI race won't stop; slow down and you lose. It might be the biggest breakthrough since the internet, but the risks rival splitting the atom. People had similar doomsday fears when the Large Hadron Collider came online... but we’re still alive, aren't we? The answer isn't pulling the plug. It's making sure the guardrails actually work before the Terminator ceases to be fiction and turns into prophecy. (clip: Forbes Breaking News)
Open source - CO
Cointelegraph@CointelegraphPost on X ·
🚨 NOW: Former Anthropic researcher Jacob Coxon will testify at a New York City Council AI hearing today, per Bloomberg. He quit last month, accusing Anthropic and OpenAI of gambling with people's lives. https://t.co/xCwvrRM1AU
Open source - TI
The Information@theinformationPost on X ·
AI is doing more of the work of building AI. Researchers are checking it less often. That’s what former Anthropic and OpenAI researcher Jacob Coxon and former OpenAI researcher Daniel Kokotajlo told the New York City Council at Monday’s hearing. Read more: https://t.co/vsD8UL5zxK
Open source - CB
Crypto BriefingArticle ·
Ex-AI lab researchers tell NYC Council humans are checking AI-built systems less often Decreased human oversight in AI development raises concerns about accountability, potential risks, and the need for robust regulatory measures. The post Ex-AI lab researchers tell NYC Council humans are checking AI-built systems less often appeared first on Crypto Briefing .
Open source - CB
Coin Bureau@coinbureauPost on X ·
🚨CONCERNING: Ex-Anthropic researcher warns AI's current path "could end in HUMAN EXTINCTION." Jacob Coxon told a NYC Council hearing it's "more likely than not that humanity loses control to these AIs." He said AI companies are being "extremely reckless given the stakes." https://t.co/e3YArMPx8f
Open source - BL
Bloomberg@businessPost on X ·
Former Anthropic researcher Jacob Coxon warned the race to develop AI poses risks that the industry itself doesn’t fully understand https://t.co/2n4dYdhNqH
Open source - CN
CNBC@CNBCPost on X ·
AI researcher warns ‘we are racing to build and grow our own adversary’ in NYC hearing https://t.co/ZTCZrQZeb9
Open source