Mitigating Reward Hacking as Institutional Design

Epistemic status: Obviously speculative but mechanism design is fun. Last year I wrote a post on reward hacking as we were then beginning to see concerning signs of scaling RLVR causing models to exhibit substantial reward hacking behaviours. Unfortunately these behaviours have seemingly only grown substantially worse and more sophisticated...

saved by

• Tazik Sh