Koan: divining alien datastructures from RAM activations — AI Alignment Forum
[Metadata: crossposted from https://tsvibt.blogspot.com/2024/04/koan-divining-alien-datastructures-from.html.] Exploring the ruins of an alien civilization, you find what appears to be a working computer——it's made of plastic and metal, wires connect it to various devices, and you see arrays of capacitors that maintain charged or uncharged states and that sometimes rapidly toggle in response to voltages from connected wires. You can tell that the presumptive RAM is activating in complex but structured patterns, but you don't know their meanings. What strategies can you use to come to understand what the underlying order is, what algorithm the computer is running, that explains the pattern of RAM activations? Thanks to Joss Oliver (SPAR) for entertaining a version of this koan. Many of B's ideas come from Joss. Red: If we want to understand how minds work, the only source of real data is our own thinking, starting from the language in which we think. Blue: That doesn't seem right. A big
x Koan: divining alien datastructures from RAM activations — AI Alignment Forum AI Frontpage 21 Koan: divining alien datastructures from RAM activations by TsviBT 5th Apr 2024 25 min read 10 21 [Metadata: crossposted from https://tsvibt.blogspot.com/2024/04/koan-divining-alien-datastructures-from.html .] Exploring the ruins of an alien civilization, you find what appears to be a working computer——it's made of plastic and metal, wires connect it to various devices, and you see arrays of capacitors that maintain charged or uncharged states and that sometimes rapidly toggle in response to voltage
related reading
- As Rocks May Think | Eric Jangevjang.com
- Datacurve | The data engine for frontier AIdatacurve.ai
- How To Understand Things - Nabeel S. Qureshinabeelqu.substack.com
- 2023 letter | Zhengdongzhengdongwang.com
- That Alien Message — LessWronglesswrong.com
- Reflections on 2025samuelalbanie.substack.com
- Forms of life, forms of mind | Dr. Michael Levin | Algorithms Redux: finding unexpected properties in truly minimal systemsthoughtforms.life
- Interpretability Dreamstransformer-circuits.pub
- How AI Is Learning to Think in Secretnickandresen.substack.com
- Three Questions that Keep Me Up at Night | Eric Jangevjang.com
- Cerebras (@cerebras) on Xx.com
- God Help Us, Let’s Try To Learn About Mechanistic Interpretability Techniquesastralcodexten.com