The AI-as-Normal-Technology view of loss of control incidents
normaltech.ai · 9,308 words · saved by 1 readers
A middle ground between the cybersecurity and AI safety communities
This essay is over 13,000 words long and represents our most substantial writing on AI safety since the original essay. Over the last few months, loss-of-control incidents at OpenAI and Anthropic have intensified concerns about AI safety. Warnings about existential risk have increasingly reached the broader public, alongside calls to slow AI development. Dario Amodei’s call to “pace the frontier” reflects the concern that safety efforts are not keeping up with AI capabilities. The most prominent example was the OpenAI - Hugging Face incident, where hundreds of OpenAI agents got access to…
saved by
related reading
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- AI as Normal Technology | Knight First Amendment Instituteknightcolumbia.org
- Personal statement on joining the OpenAI boardpaulfchristiano.substack.com
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- Reading Listblog.redwoodresearch.org
- The Case Against AI Control Research — LessWronglesswrong.com
- AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
- Paul Christiano (@paulfchristiano) on Xx.com
- What failure looks like — LessWronglesswrong.com
- The Huggingface Incident - by Scott Alexanderastralcodexten.com
- China Says It Cares About Loss of Controlocpl.substack.com
- The OpenAI/Hugging Face Incident: Challenges in Controlling and Containing Cyber-Capable AI Systems - Institute for AI Policy and Strategyiaps.ai