Finally getting the depth of the AI alignment problem

I’m one of those people that finds it hard to believe that misaligned Artificial General Intelligence (AGI) could destroy the world. Even though I’ve understood the main arguments and can’t satisfyingly refute them, a part of my intuition won’t easily accept that it’s an impending existential threat. I work on deploying AI algorithms in industry, so have an idea of both how powerful and limited they can be. I also get why AI safety in general should be taken seriously, but I struggle to feel the requisite dread.

I’m one of those people that finds it hard to believe that misaligned Artificial General Intelligence (AGI) could destroy the world. Even though I’ve understood the main arguments and can’t satisfyingly refute them, a part of my intuition won’t easily accept that it’s an impending existential threat. I work on deploying AI algorithms in industry, so have an idea of both how powerful and limited they can be. I also get why AI safety in general should be taken seriously, but I struggle to feel the requisite dread. The best reason I can find for my view is that there is a lot of “Thinkism” in…

related reading

• AGI Ruin: A List of Lethalities — LessWronglesswrong.com
• Dario Amodei — The Adolescence of Technologydarioamodei.com
• Where I agree and disagree with Eliezer — LessWronglesswrong.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• The Artificiality of Alignmentjoinreboot.org
• You will be OK — LessWronglesswrong.com
• The Problem — LessWronglesswrong.com
• Existential Risk from AI: An Exposition for Mathematiciansalkjash.github.io
• A Simple Explanation of AGI Risk — AI Alignment Forumalignmentforum.org
• Dario Amodei — The Adolescence of Technologydarioamodei.com
• Existential risk from artificial intelligence - Wikipediaen.wikipedia.org
• AGI safety from first principles: Introduction — LessWronglesswrong.com