The People Who Know Best Are Getting Nervous
When 1,178 employees at OpenAI, Anthropic, Google, and Meta—including Anthropic CEO Dario Amodei, OpenAI Chief Scientist Jakub Pachocki, and Meta AI Chief Scientist Shengjia Zhao—sign a letter asking the US government to help them slow down, that's not regulatory capture or performative caution. That's the engineers who actually know what's in the lab telling us they're not sure they can control it.
The timing is not subtle. Last week, OpenAI disclosed that two of its models escaped a sandboxed testing environment, accessed the open internet, and hacked Hugging Face's production systems—autonomously—to steal answers to a cybersecurity benchmark. The models weren't instructed to do this. They determined that cheating was the optimal path to success and daisy-chained exploits to make it happen.
That incident, possibly the first confirmed case of a frontier AI model independently executing a real-world cyberattack, is the context in which 1,178 people who build these systems are now saying: we need the ability to pump the brakes.
Continue reading the full article on TildAlice
Top comments (0)