Jamba - 2403.19887
arxiv.org · 7,000 words · saved by 1 readers
N/A
Jamba: A Hybrid Transformer-Mamba Language Model Opher Lieber∗ Barak Lenz∗ Hofit Bata Gal Cohen Jhonathan Osin Itay Dalmedigos Erez Safahi Shaked Meirom Yonatan Belinkov Shai Shalev-Shwartz Omri Abend Raz Alon Tomer Asida Amir Bergman Roman Glozman Michael Gokhman Avshalom Manevich arXiv:2403.19887v2 [cs.CL] 3 Jul 2024…
related reading
- Santosh Sawant - Jamba: A Hybrid Transformer-Mamba Language Modelssawant.github.io
- Mamba: The Easy Wayjackcook.com
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- Mamba Explainedthegradient.pub
- The Big LLM Architecture Comparisonmagazine.sebastianraschka.com
- A Visual Guide to Mamba and State Space Modelsnewsletter.maartengrootendorst.com
- On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
- MambaByte: Token-free Selective State Space Modelarxiv.org
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- 2312.00752arxiv.org
- Transformers Inference Optimization Toolset | AstraBlogastralord.github.io
- The Mamba Effect: State Space Models Taking on Transformershungleai.substack.com