flâneur

Inside the Inference Hardware Revolution Of 2026 - IEEE Spectrum

spectrum.ieee.org · 3,354 words · saved by 2 readers

Today’s tidal wave of queries is forcing hardware makers to pivot

Tensordyne’s Napier chip is designed to accelerate AI inference. Since about 2020, AI has largely focused on training bigger and better models. Large language models (LLMs) ballooned from millions of parameters to trillions. This proved effective: The largest version of OpenAI’s GPT-3, released in 2020, correctly answered just 43.9 percent of questions on a popular knowledge-and-reasoning benchmark. Just four years later, GPT-4o reached a score of 88.7 percent on the same exam, effectively matching those of human experts. Advanced AI labs are still training ever larger models, but that…

saved by

related reading