Catch-Up Algorithmic Progress Might Actually be 60× per Year — LessWrong
lesswrong.com · saved by 1 readers
Summary The canonical paper about Algorithmic Progress is by Ho et al. (2024) who find that, historically, the pre-training compute used to reach a…