What is the alignment problem? - by Jan Leike
aligned.substack.com · 829 words · saved by 1 readers
My attempt at clarifying a confusing topic
What is the alignment problem? My attempt at clarifying a confusing topic Jan Leike Mar 29, 2022 51 5 1 Share On a very high level, building performant AI systems requires two ingredients: Capability: The AI system could do the intended task. Alignment: The AI system does the intended task as well as it could. Thus if the system doesn’t do the intended task, then this is always due to a capability problem, an alignment problem, or both. Usually we talk about alignment with human intentions. In this case the intended task is whatever the human wanted the system to do. Examples We’re all familia
related reading
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- What is AI alignment? - by Adam Jones - BlueDot Impactblog.bluedot.org
- The Artificiality of Alignmentjoinreboot.org
- Defining alignment research — LessWronglesswrong.com
- Alignment Is Proven To Be Solvable - by SE Gygesverysane.ai
- Alignment remains a hard, unsolved problem — AI Alignment Forumalignmentforum.org
- A minimal viable product for alignment - by Jan Leikealigned.substack.com
- Current AIs seem pretty misaligned to meblog.redwoodresearch.org
- The Universe from an Intentional Stancecasparoesterheld.com
- Off Target | CNAScnas.org