How can we solve diffuse threats like research sabotage with AI control?

Preventing research sabotage will require techniques very different from the original control paper.

How can we solve diffuse threats like research sabotage with AI control? Preventing research sabotage will require techniques very different from the original control paper. Vivek Hebbar Apr 30, 2025 9 Share Misaligned AIs might engage in research sabotage: making safety research go poorly by doing things like withholding their best ideas or putting subtle bugs in experiments. To mitigate this risk with AI control, we need very different techniques than those in the original control paper or Ctrl-Z , because research sabotage differs from those settings in two crucial ways: Firstly, the AI can

saved by

• Dylan Fridman
• Jo J.
• Arjun Khandelwal

related reading

• How can we solve diffuse threats like research sabotage with AI control? — LessWronglesswrong.com
• How can we solve diffuse threats like research sabotage with AI control?redwoodresearch.substack.com
• The Case Against AI Control Research — LessWronglesswrong.com
• Thoughts on the conservative assumptions in AI controlblog.redwoodresearch.org
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• Notes on handling non-concentrated failures with AI control: high level methods and different regimesblog.redwoodresearch.org
• Catching AIs red-handedblog.redwoodresearch.org
• Win/continue/lose scenarios and execute/replace/audit protocolsblog.redwoodresearch.org
• Reading Listblog.redwoodresearch.org
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
• AI 2040: Plan Aai-2040.com
• Research Areas in AI Control (The Alignment Project by UK AISI) — AI Alignment Forumalignmentforum.org