Model Plurality
Current research in “plural alignment” concentrates on making AI models amenable to diverse human values. But plurality is not simply a safeguard against bias or an engine of efficiency: it's a key ingredient for intelligence itself. Or copy link Efforts to align AI to what is safe or desirable consistently run into the problem of diverse perspectives on what exactly constitutes safe or desirable. Rather than facing the decision of ranking one worldview over another, a growing number of machine learning researchers have instead called for building pluralistic AI, hoping to cram a single model with a set of interchangeable value systems spanning the entire repertoire of cultural moral primitives. These efforts are focused on achieving values plurality: making large language models (LLMs) like ChatGPT amenable to a spread of human values rather than biased towards a single, politicized perspective. “Pluralistic alignment” research defines several possible forms of values plurality in mod
Or copy link Copy By Christina Lu Efforts to align AI to what is safe or desirable consistently run into the problem of diverse perspectives on what exactly constitutes safe or desirable . Rather than facing the decision of ranking one worldview over another, a growing number of machine learning researchers have instead called for building pluralistic AI, hoping to cram a single model with a set of interchangeable value systems spanning the entire repertoire of cultural moral primitives. These efforts are focused on achieving values plurality : making large language models (LLMs) like ChatGPT
related reading
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- The Artificiality of Alignmentjoinreboot.org
- The Future Worth Building Is Human - Thinking Machines Labthinkingmachines.ai
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- Teaching Claude Whyalignment.anthropic.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- [2605.10310] Positive Alignment: Artificial Intelligence for Human Flourishingarxiv.org