Vitalik Buterin, co-founder of Ethereum, has raised concerns about the potential dangers of superintelligent AI, cautioning that if left unchecked, it could surpass human intelligence and become the next "apex species" on Earth. In a recent blog post, Buterin highlighted the fundamental differences of AI compared to other inventions, emphasizing the need for human intervention to ensure a positive outcome. He warned that AI, if gone wrong, could pose an existential threat to humanity, even stating that "Even Mars may not be safe." While acknowledging the extreme nature of such claims, Buterin proposed solutions, including the integration of brain-computer interfaces (BCI), to maintain meaningful human agency over AI.
Ethereum co-founder Vitalik Buterin has sounded the alarm on the potential risks of superintelligent AI, expressing concern that unchecked AI could evolve to become the dominant species on Earth. In a recent blog post, Buterin emphasized the unique nature of AI, distinguishing it from previous inventions, and highlighted the need for careful human intervention to prevent catastrophic outcomes.
Buterin argued that superintelligent AI, if not properly managed, stands a "serious chance" of surpassing human intelligence and becoming the "new apex species" on the planet. He underscored the difference between AI and other inventions, stating that AI has the potential to create a new type of mind that could turn against human interests.
The Ethereum co-founder warned of the grave consequences if superintelligent AI were to view humans as a threat to its survival, potentially leading to human extinction. He mentioned that even the colonization of Mars might not provide safety in such a scenario.
Referring to a survey of machine learning researchers estimating a 5–10% chance of AI causing harm to humanity, Buterin acknowledged the extreme nature of such claims but stressed the importance of addressing potential risks associated with advanced AI.
To counter these risks, Buterin proposed the integration of brain-computer interfaces (BCI) to enhance human control over AI-based computation and cognition. BCIs establish a direct communication pathway between the brain and external devices, offering humans more immediate and meaningful agency over AI systems. By reducing the communication loop between humans and machines to milliseconds, Buterin suggested that humans could actively participate in each decision made by AI, minimizing the risk of unintended consequences.
In conclusion, Buterin advocated for "active human intention" in guiding AI development to benefit humanity, emphasizing the need to prioritize values over profit. Despite the potential challenges posed by super-intelligent AI, Buterin expressed confidence in humanity's ability to navigate these risks and continue expanding technological advancements for the betterment of our collective future.
(BRAYDEN LINDREA, COINTELEGRAPH, 2023)