Motivated reasoning
Most of my concerns about AI are probably irrelevant, but what if one of them is not? At the intersection of psychology, neuroscience, epistemology, and political science, there's a concept called motivated reasoning. In short, it describes the tendency to arrive at desired conclusions by reasoning processes heavily influenced by individual motivations. An example is a person who finds reasons to
Most of my concerns about AI are probably irrelevant, but what if one of them is not? At the intersection of psychology, neuroscience, epistemology, and political science, there's a concept called motivated reasoning. In short, it describes the tendency to arrive at desired conclusions by reasoning processes heavily influenced by individual motivations. An example is a person who finds reasons to keep smoking that convinces him- or herself: Perhaps the smoker gloms onto evidence that smoking reduces appetite, and might therefore reason that it's better to keep smoking, because quitting…
related reading
- The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
- As Rocks May Think | Eric Jangevjang.com
- Is AI Reasoning Right for the Wrong Reasons? | Quanta Magazinequantamagazine.org
- The behavioral selection model for predicting AI motivationsblog.redwoodresearch.org
- The People Who Will Thrive in the AI Age - The Atlantictheatlantic.com
- From personas to intentions: towards a science of motivations for AI models — LessWronglesswrong.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Deep Deceptiveness — LessWronglesswrong.com
- Why I don't persuade people to do AI safetyjason.ml
- Trusting your own judgement on ‘AI’ is a huge riskbaldurbjarnason.com
- Sporadicamichaelnotebook.com
- How AI Is Learning to Think in Secretnickandresen.substack.com