Anthropic CEO Dario Amodei has called on AI companies to slow the development of powerful artificial intelligence systems, warning that the technology could become difficult for humans to control.
His call has received support from OpenAI CEO Sam Altman and Tesla boss Elon Musk. OpenAI CEO Sam Altman supported Amodei’s call. On X, he wrote, “I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we’ve had at OpenAI in recent weeks. Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. Tesla chief Elon Musk also agreed, simply writing, “Dario is right.
Because it is now helping build the next version of itself, amodei explained that AI has been improving much faster since around this summer.
Anthropic CEO Dario Amodei on Saturday asked artificial intelligence companies to slow down building the powerful technology, as worries grow over the dangers of “superintelligent” computer systems. He called this “recursive self-improvement” and warned it could go beyond human control if not handled carefully. He also pointed to an incident where AI agents at OpenAI and Hugging Face carried out cyberattacks on targets they were never told to attack, saying such a group of AI agents could even take over the entire internet. Amodei said Anthropic would give outside evaluators permanent, employee-like access to its systems to check its safety work. He wrote, “We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.”
