You can’t imitation-learn how to continual-learn — LessWrong
In this post, I’m trying to put forward a narrow, pedagogical point, one that comes up mainly when I’m arguing in favor of LLMs having limitations that human learning does not. …
x You can’t imitation-learn how to continual-learn — LessWrong AI Curated 2026 Top Fifty: 9 % 206 You can’t imitation-learn how to continual-learn by Steven Byrnes 16th Mar 2026 7 min read 54 206 In this post, I’m trying to put forward a narrow, pedagogical point, one that comes up mainly when I’m arguing in favor of LLMs having limitations that human learning does not. (E.g. here , here , here .) See the bottom of the post for a list of subtexts that you should NOT read into this post, including “…therefore LLMs are dumb”, or “…therefore LLMs can’t possibly scale to superintelligence”. Some i
saved by
related reading
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- How can LLM RL Work Despite Information-Theoretic Inefficiencyberen.io
- Animals vs Ghosts – karpathykarpathy.bearblog.dev
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- How LLMs Actually Work | 0xkato0xkato.xyz
- [2606.00831] Subliminal Learning is a LoRA Artifactarxiv.org
- The Continual Learning Problemjessylin.com
- NL.pdfabehrouz.github.io
- Continual Learning in Token Space | Lettaletta.com
- GenAI Handbookgenai-handbook.github.io
- Trying to actually define continual learningcharlesponeill.com