A Conservative Approach to AGI - The American Mind
“Artificial general intelligence” (AGI) is typically defined as any computer system that can match or surpass human intelligence in performing any task a human can perform. No such program yet exists, but if one were to arise it could instantly begin improving its own capabilities. The result might be a kind of superintelligence, as far beyond our own intelligence as ours is beyond that of snails There exists no natural limit to this process. The only guardrails would be those we construct now, before the avalanche begins. The timeline remains uncertain, yet the “San Francisco consensus” among AI researchers predicts superintelligence by decade’s end. Skeptics raise legitimate concerns about decades of failed predictions. But when Nobel laureates warn of extinction and industry leaders purchase remote bunkers or speak of “summoning the demon,” prudence demands attention. These are not Luddites but AI’s very architects sounding the alarm. At the heart of the concern that AI could cause
Salvo 07.16.2025 5 minutes A Conservative Approach to AGI Mark Benton Beall, Jr. Neither a Luddite nor a utopian be. “Artificial general intelligence” (AGI) is typically defined as any computer system that can match or surpass human intelligence in performing any task a human can perform. No such program yet exists, but if one were to arise it could instantly begin improving its own capabilities. The result might be a kind of superintelligence, as far beyond our own intelligence as ours is beyond that of snails There exists no natural limit to this process. The only guardrails would be those w
related reading
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- Planning for AGI and beyond | OpenAIopenai.com
- Nick Bostrom’s Home Pagenickbostrom.com
- The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophepossessedmachines.com
- The Artificial Intelligence Revolution: Part 2 - Wait But Whywaitbutwhy.com
- A Simple Explanation of AGI Risk — AI Alignment Forumalignmentforum.org
- The Problem — LessWronglesswrong.com
- Existential risk from artificial intelligence - Wikipediaen.wikipedia.org
- A Framework for Frontier AI and the Dawning of a New Agedemishassabis.substack.com
- Center for a Stateless Society >> Review: Superintelligence — Paths, Dangers, Strategiesc4ss.org
- Superintelligence: The Idea That Eats Smart Peopleidlewords.com
- Explore: AI alignmentarbital.greaterwrong.com