Base Models Can Reason By Taking a Cue From Training Data
sophielwang.com · saved by 3 readers
This writeup gives a high-level overview of our paper and aims to build intuition for what it means for a base language model to reason. We walk through some interesting nuggets from our findings, illustrate them with interactive figures, and discuss implications raised by our results. Details can be found in the paper.