Is GPT-4 getting worse over time?
aisnakeoil.com · 1,514 words · saved by 1 readers
A new paper going viral has been widely misinterpreted
Is GPT-4 getting worse over time? A new paper going viral has been widely misinterpreted Arvind Narayanan and Sayash Kapoor Jul 19, 2023 124 13 12 Share A new paper making the rounds is being interpreted as saying that GPT-4 has gotten worse since its release. Unfortunately, this is a vast oversimplification of what the paper found. And while the findings are interesting, some of the methods are questionable, so it’s worth digging into the details. Capability ≠ behavior One important concept to understand about chatbots is that there is a big difference between capability and behavior. A model
related reading
- Is GPT-4 getting worse over time?normaltech.ai
- gpt-4.pdfcdn.openai.com
- GPT-4openai.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- gpt-4-system-card.pdfcdn.openai.com
- Expanding on what we missed with sycophancy | OpenAIopenai.com
- AI progress is about to speed up | Epoch AIepoch.ai
- 2303.08774.pdfarxiv.org
- What will GPT-2030 look like? — AI Alignment Forumalignmentforum.org
- How fast is AI improving? - AI Digesttheaidigest.org
- [2303.12712] Sparks of Artificial General Intelligence: Early experiments with GPT-4arxiv.org
- Noam Brown on X: "Implications of Large-Scale Test-Time Compute" / Xx.com