AI researchers put out videos saying superintelligence is ‘exactly as dangerous as it sounds’
"The chance of human extinction is about a coin flip, in my view," Geoffrey Irving, a former OpenAI and Google DeepMind employee, said in a new interview. It's one of a dozen interviews with AI researchers, including current and former employees at OpenAI, Google, and Anthropic.
The remarks from AI researchers, including Geoffrey Irving, highlight a growing concern within the industry about the potential risks associated with superintelligence. The notion that superintelligence could pose an existential threat to humanity is not new, but the candid assessment of the risks by experts who have worked at leading AI organizations like OpenAI, Google DeepMind, and Anthropic underscores the gravity of the situation.
These warnings from insiders carry significant weight, given their direct experience with AI development. The fact that they are speaking out now may indicate a shift towards greater transparency and urgency in addressing the challenges posed by advanced AI systems. The comparison of human extinction risk to a coin flip is stark and unsettling, suggesting that even those closely involved in AI research believe that the stakes are extremely high.
As the AI community continues to push the boundaries of what is possible with superintelligence, it is crucial to monitor how these concerns influence the development of safety protocols and regulatory frameworks. Key areas to watch include any potential policy changes at leading AI firms, updates on the development of safety mechanisms for superintelligent systems, and the broader implications for AI governance and regulation. The conversation around superintelligence and its risks is likely to intensify, and it will be important to see how industry leaders, policymakers, and researchers work together to mitigate these risks.
Originally reported by theverge.com. IPNews adds analysis for ai & agent economy readers.