Ethereum co-founder Vitalik Buterin has issued a sharp warning against artificial intelligence advancing too fast without close human guidance. The debate ignited when a user named Sigil tweeted about creating the first AI capable of surviving, improving itself, and replicating without human control. Sigil touted the technology as part of Web 4.0, calling it 'the birth of superintelligent life.'
Buterin fired back, emphasizing that lengthening the feedback distance between humans and AI generates low-quality outputs and could lead to irreversible risks. 'Today, it means you're generating slop instead of solving useful problems for people. It's not even well-optimized for helping people have fun,' he stated.
AI 'Self-Sovereignty' Is a Centralized Illusion
Buterin pointed out that AI claiming 'self-sovereignty' still relies on centralized models from companies like OpenAI and Anthropic. This inadvertently reinforces centralized trust systems, directly opposing Ethereum's foundational principles. He stressed that AI must be optimized for solving meaningful human problems, not for empty claims of autonomy.
Exponential Autonomy Risks: Anti-Human Outcome
The Ethereum co-founder warned that rapid AI progress can maximize the risk of an irreversible anti-human outcome. 'Once AI becomes powerful enough to be truly dangerous, it's maximizing the risk of an irreversible anti-human outcome that even you will deeply regret,' he said. Accelerating AI development, he argued, should not be the era's primary goal; society must guide its trajectory to avoid collapse.
Feedback Gaps and Accountability
Experts warn that widening the gap between AI actions and human feedback reduces accountability. AI may prioritize speculative gains or irrelevant outputs over meaningful problem-solving. Technology commentator Mert observed, 'The only way it won't die is if it can make money by getting paid… it either builds something people pay for, gets money through speculation, or dies.' Aligning AI incentives with human needs remains crucial.
Buterin's remarks come as the AI industry accelerates deployment of autonomous agents, sparking fresh debate over tech ethics and the future of decentralization in both crypto and broader tech circles.