Jacob Coxon resigned as a researcher at Anthropic on Tuesday. He accused Anthropic and OpenAI of "gambling with our lives" in a post on X. Coxon has worked as a researcher at both companies. He said both are racing toward self-improving superintelligence. Evan Hubinger, an alignment lead at Anthropic, publicly agreed. Hubinger put the chance of AI killing all humans above 10% within a decade. He said Anthropic has no plan yet for keeping superhuman systems in line with human intentions. OpenAI chief scientist Jakub Pachocki called on Sunday for voluntary slowdowns and international coordination. Two bills are before Congress: the FRONTIER Act and the Ban Artificial Superintelligence Act. Both have had mixed receptions.
What changed
Extinction-risk warnings came mostly from outside the labs or from past employees.
- post viewed 70M+ times
- 10%+ chance within a decade
- ~1,400 researchers signed letter
Sources