flâneur

thebes on X: "i dislike how people talk about model looping in a binary way when it comes to monitorability when what actually matters is effective depth and how it affects verbalization necessity afaict the chain of thought for experienced researchers concerned about the news is something https://t.co/6iLLCTUOmd" / X

x.com · 144 words · saved by 1 readers

i dislike how people talk about model looping in a binary way when it comes to monitorability when what actually matters is effective depth and how it affects verbalization necessity afaict the chain of thought for experienced researchers concerned about the news is something like: "previously, h…

i dislike how people talk about model looping in a binary way when it comes to monitorability when what actually matters is effective depth and how it affects verbalization necessity afaict the chain of thought for experienced researchers concerned about the news is something like: "previously, hardware limited parameter count, and parameter count + a reasonable aspect ratio limited maximum depth. looping lets you reuse the same parameters for more depth, removing this ceiling, allowing for higher effective depth on the existing hardware and reducing the 'necessity' arm of CoT…

saved by

related reading