Is Tokenization Needed for Masked ParticleModelling?
arxiv.org · 7,197 words · saved by 1 readers
N/A
Is Tokenization Needed for Masked Particle Modelling? Matthew Leigh Samuel Klein François Charton University of Geneva University of Geneva Meta FAIR matthew.leigh@unige.ch samuel.klein@unige.ch fcharton@meta.com arXiv:2409.12589v2 [hep-ph] 1 Oct 2024…
related reading
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- The Bitter Lesson is coming for Tokenization – ⛰️ lucalplucalp.dev
- 2409.02908arxiv.org
- On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
- Shaping capabilities with token-level data filteringarxiv.org
- The Annotated JEPA | Elements of a Vector Spaceelonlit.com
- The Annotated Transformernlp.seas.harvard.edu
- How not to do research - Rajan Agarwalrajan.sh
- You Can Learn Tokenization End-to-End with Reinforcement Learningarxiv.org
- Fast Training of Diffusion Models with Masked Transformers | PDFarxiv.org
- H-Nets - the Past | Goomba Labgoombalab.github.io
- [2605.06546] Efficient Pre-Training with Token Superpositionarxiv.org