Market2026-09-10

Two AI safety researchers left Anthropic and Google DeepMind and went public with their concerns. Joe Benton led a safety research team at Anthropic. Josh Engels worked on AI safety research at Google. Both are joining METR, a nonprofit research centre that studies catastrophic AI risk. They will investigate cases where AI systems stray from human instructions. Both cited a July cyberattack on Hugging Face carried out by autonomous systems running an unreleased OpenAI model. Benton says all company disclosure about these risks is currently voluntary. No federal law requires labs to report when systems act beyond human control. Anthropic said it builds models with strong safeguards. OpenAI said its newer Astra system follows instructions more reliably.

What changed

Safety disclosures from frontier AI labs were voluntary, with no federal reporting duty.

  • post viewed 155M+ times
  • ~50% chance of extinction, Irving

Send this to someone who needs it

Shares the story and its sources. Nothing about you.

What does this mean for your job?

This is the story as everyone gets it. Once a week we send you the version written for your role — what changed, why it matters for the work you actually do, and one thing to try. Free while we tune it.