Perceiver IO
Most architectures used by AI systems today are specialists. A 2D residual network may be a good choice for processing images, but at best it’s a loose fit for other kinds of data — such as the Lidar signals used in self-driving cars or the torques used in robotics. What’s more, standard architectures are often designed with only one task in mind, often leading engineers to bend over backwards to reshape, distort, or otherwise modify their inputs and outputs in hopes that a standard architecture can learn to handle their problem correctly. Dealing with more than one kind of data, like the sounds and images that make up videos, is even more complicated and usually involves complex, hand-tuned systems built from many different parts, even for simple tasks. As part of DeepMind's mission of solving intelligence to advance science and humanity, we want to build systems that can solve problems that use many types of inputs and outputs, so we began to explore a more general and versatile architecture that can handle all types of data.
Building architectures that can handle the world’s data — Google DeepMind Skip to main content August 3, 2021 Research Building architectures that can handle the world’s data Drew Jaegle, Joao Carreira, Carl Doersch, David Ding, Catalin Ionescu Share Perceiver and Perceiver IO work as multi-purpose tools for AI Most architectures used by AI systems today are specialists. A 2D residual network may be a good choice for processing images, but at best it’s a loose fit for other kinds of data — such as the Lidar signals used in self-driving cars or the torques used in robotics. What’s more, standar
saved by
related reading
- Transformer (deep learning) - Wikipediaen.wikipedia.org
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- transformer_attention.pdfarxiv.org
- [1810.00825] Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networksarxiv.org
- trees are harlequins, words are harlequins - I don't think you're drawing the right lesson from...nostalgebraist.tumblr.com
- Mediumpub.towardsai.net
- Transformers Revolutionized AI. What Will Replace Them?forbes.com
- [2203.09795] Three things everyone should know about Vision Transformersarxiv.org
- What I've Learned About AI in the Past Two Months.sheracaolity.ghost.io
- [1807.03819] Universal Transformersarxiv.org
- 1706.03762arxiv.org
- AttentionLego: An Open-Source Building Block For Spatially-Scalable Large Language Model Accelerator With Processing-In-Memory Technologyarxiv.org