AI is easy to control – AI Optimism
Why are billions of dollars being poured into artificial intelligence R&D this year? Companies certainly expect to get a return on their investment. Arguably, the main reason AI is profitable i…
Why are billions of dollars being poured into artificial intelligence R&D this year? Companies certainly expect to get a return on their investment. Arguably, the main reason AI is profitable is that it is more controllable than human labor. The personality and conduct of an AI can be controlled to much finer grained precision than that of any human employee. Chatbots like GPT-4 and Claude undergo a “supervised fine tuning” phase, where their neural circuitry is directly optimized to say certain words, phrases, and sentences in specified contexts. Algorithms like direct preference…
related reading
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- AI 2027ai-2027.com
- The Case Against AI Control Research — LessWronglesswrong.com
- Introduction to AI Control - by Sarah - BlueDot Impactblog.bluedot.org
- The case for ensuring that powerful AIs are controlledblog.redwoodresearch.org
- Introduction to AI Control - by Sarah - BlueDot Impactbluedot.org
- AI 2027ai-2027.com
- I think alignment work is more promising than control work — LessWronglesswrong.com
- Reading Listblog.redwoodresearch.org
- Research Areas in AI Control (The Alignment Project by UK AISI) — AI Alignment Forumalignmentforum.org
- The case for ensuring that powerful AIs are controlled — AI Alignment Forumalignmentforum.org
- 7+ tractable directions in AI control — AI Alignment Forumalignmentforum.org