Kaiyue Wen on X: "Can LLMs generate novel research ideas? We propose Priced Guidance to quantify this via compression! We lower bound P(LLM forecasts a future paper’s idea X). Instead of sampling ideas until X is matched, the LLM plays “20 Questions” to recover X, charging each hint by surprisal. https://t.co/QKE1byIV2Y" / X
x.com · saved by 1 readers
Can LLMs generate novel research ideas? We propose Priced Guidance to quantify this via compression! We lower bound P(LLM forecasts a future paper’s idea X). Instead of sampling ideas until X is matched, the LLM plays “20 Questions” to recover X, charging each hint by surprisal.