Let's bet on this shit

People talk a lot about acting rationally once you consider your beliefs as axiomatic, particularly in AI. We have many examples of this. For instance, people have been talking about scaling laws since GPT-2 (and even beforehand); they would tell you to be scaling pilled. Well, we didn’t actually see that many of them throwing away everything to get more compute, more data, and investing in NVIDIA

People talk a lot about acting rationally once you consider your beliefs as axiomatic, particularly in AI. We have many examples of this. For instance, people have been talking about scaling laws since GPT-2 (and even beforehand); they would tell you to be scaling pilled. Well, we didn’t actually see that many of them throwing away everything to get more compute, more data, and investing in NVIDIA call options. Similarly, people talk about being AGI pilled. Well, if that’s your belief, that AGI will hit in the next year or two with the current transformer paradigm, why aren’t you buying as…

related reading

• Trust me bro, just one more RL scale up, this one will be the real scale up with the good environments, the actually legit one, trust me bro — AI Alignment Forumalignmentforum.org
• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
• Will scaling work?dwarkeshpatel.com
• RL Environments and RL for Science: Data Foundries and Multi-Agent Architecturesnewsletter.semianalysis.com
• The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
• Trust me bro, just one more RL scale up, this one will be the real scale up with the good environments, the actually legit one, trust me broblog.redwoodresearch.org
• The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• What if RL Environments Aren't Mispriced?benanderson.work
• Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
• The Bitter Lesson - RL Environments Versionseancai.com