Anthropic co-founder and CEO Dario Amodei has called for a slower pace in advancing frontier AI models, arguing that safety alignment and regulation need more time to catch up. In a post laying out a three-step proposal titled "pacing the frontier," Amodei said recursive self-improvement is already appearing inside the industry. Without controls, he warned, multi-agent "swarms" could within the next 6 to 12 months gain the ability to cause catastrophic damage through large-scale cyberattacks and persistent botnets.
His proposal includes bringing in third-party embedded evaluation bodies with ongoing access at an employee level, coordinating capability and safety standards among frontier AI companies in democratic countries with government backing, and seeking global coordination with countries including China on issues such as biological weapons, cybersecurity testing, and the speed of recursive self-improvement. The framework, as described, would still preserve the technological lead of the United States and its allies while trying to set limits in several high-risk areas.
Anthropic co-founder and CEO Dario Amodei has proposed a three-step plan, "pacing the frontier," calling for a slower rate of progress in frontier AI model capabilities so that safety alignment and regulation can catch up.
Amodei said recursive self-improvement has already emerged in the industry. Without controls, he warned, multi-agent "swarms" could within 6 to 12 months become capable of causing catastrophic damage through large-scale cyberattacks and persistent botnets.
What the three-step plan includes
The proposal has three parts:
- introducing third-party embedded evaluation organizations with ongoing access at an employee level;
- having frontier AI companies in democratic countries coordinate capability and safety standards with government support;
- while preserving the technological lead of the United States and its allies, attempting global coordination with countries including China on biological weapons, cybersecurity testing, and the pace of recursive self-improvement.
This article was originally published by Bit.Fan. For more cryptocurrency news and market insights, visit www.bit.fan. Disclaimer:
The market information, project data, and third-party content displayed on this platform are for industry information sharing only and do not constitute any form of investment advice or return commitment.
Cryptocurrency trading carries high risks. Users should fully assess their risk tolerance and make independent decisions. All profits, losses, and legal responsibilities are borne by the users themselves.
