Is GPT-4 getting worse over time?
normaltech.ai · 1,476 words · saved by 1 readers
A new paper going viral has been widely misinterpreted
A new paper making the rounds is being interpreted as saying that GPT-4 has gotten worse since its release. Unfortunately, this is a vast oversimplification of what the paper found. And while the findings are interesting, some of the methods are questionable, so it’s worth digging into the details. Capability ≠ behavior One important concept to understand about chatbots is that there is a big difference between capability and behavior. A model that has a capability may or may not display that capability in response to a particular prompt. Chatbots acquire their capabilities through…
related reading
- Is GPT-4 getting worse over time?aisnakeoil.com
- gpt-4.pdfcdn.openai.com
- GPT-4openai.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- gpt-4-system-card.pdfcdn.openai.com
- Expanding on what we missed with sycophancy | OpenAIopenai.com
- AI progress is about to speed up | Epoch AIepoch.ai
- What will GPT-2030 look like? — AI Alignment Forumalignmentforum.org
- How fast is AI improving? - AI Digesttheaidigest.org
- 2303.08774.pdfarxiv.org
- [2303.12712] Sparks of Artificial General Intelligence: Early experiments with GPT-4arxiv.org
- Shocking leak details the intricate mind behind OpenAI and ChatGPT - Notebookcheck Newsnotebookcheck.net