Llama 2 follow-up: too much RLHF, GPU sizing, technical details

The community reaction to Llama 2 and all of the things that I didn't get to in the first issue.

Llama 2 follow-up: too much RLHF, GPU sizing, technical details The community reaction to Llama 2 and all of the things that I didn't get to in the first issue. Nathan Lambert Jul 21, 2023 22 Share Following all of the Llama 2 news in the last few days would've been beyond a full-time job. The information networks truly were overflowing with takes, experiments, and updates. It'll still be like this for another week at least, but there are already some crucial points. In this post, I will clarify a couple of corrections I made to the original post on all things Llama 2, and then I will continue

related reading

• RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
• RLHF & Post-Training Course by Nathan Lambertrlhfbook.com
• Fine-tune Llama 2 with DPOhuggingface.co
• rlhfbook.com/book.pdfrlhfbook.com
• The Llama Hitchiking Guide to Local LLMs – hackerllamaosanseviero.github.io
• State of RL for reasoning LLMs | A. Weersaweers.de
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• LLM Training: RLHF and Its Alternativesmagazine.sebastianraschka.com
• Introduction | RLHF and Post-Training Book by Nathan Lambertrlhfbook.com
• The N Implementation Details of RLHF with PPO | ICLR Blogposts 2024iclr-blogposts.github.io
• A simple technical explanation of RLH(AI)F | Kairos.fmkairos.fm
• Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com