OpenAI’s policies hinder reproducible research on language models
normaltech.ai · 709 words · saved by 1 readers
LLMs have become privately-controlled research infrastructure
Researchers rely on ML models created by companies to conduct research. One such model, OpenAI's Codex, has been used in about a hundred academic papers1. Codex, like other OpenAI models, is not open source, so users rely on OpenAI for accessing the model. On Monday, OpenAI announced that it would discontinue support for Codex by Thursday. Hundreds of academic papers would no longer be reproducible: independent researchers would not be able to assess their validity and build on their results. And developers building applications using OpenAI's models wouldn't be able to ensure their…
related reading
- OpenAI’s policies hinder reproducible research on language modelsaisnakeoil.substack.com
- Google "We Have No Moat, And Neither Does OpenAI"semianalysis.com
- 2025: The year in LLMssimonwillison.net
- State of AI 2025: 100T Token LLM Usage Study | OpenRouteropenrouter.ai
- Marin is charting the way to the open frontier of artificial intelligencemarin.community
- Not Pinning Your OpenRouter Provider Might Invalidate Your Research — LessWronglesswrong.com
- AINews | AINewsnews.smol.ai
- Things we learned about LLMs in 2024simonwillison.net
- A History of the Future, 2025-2040 — LessWronglesswrong.com
- Catching up on the weird world of LLMssimonwillison.net
- Stanford CRFMcrfm.stanford.edu
- Late Takes on OpenAI o1alexirpan.com