flâneur

Templates for Chat Models

huggingface.co · 1,388 words · saved by 1 readers

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

The chat basics guide covers how to store chat histories and generate text from chat models using TextGenerationPipeline. This guide is intended for more advanced users, and covers the underlying classes and methods, as well as the key concepts for understanding what’s actually going on when you chat with a model. The critical insight needed to understand chat models is this: All causal LMs, whether chat-trained or not, continue a sequence of tokens. When causal LMs are trained, the training usually begins with “pre-training” on a huge corpus of text, which creates a “base” model. These…

related reading