Model Spec Midtraining: Improving How Alignment Training Generalizes | alphaXiv
alphaxiv.org · saved by 1 readers
Model Spec Midtraining (MSM) introduces a two-stage training approach that first pre-trains language models on synthetic documents derived from a "Model Spec" before standard alignment fine-tuning....