What's In My Human Feedback? Learning Interpretable Descriptions of Preference Data | alphaXiv
alphaxiv.org · saved by 1 readers
WIMHF, a method for automatically learning and describing interpretable features from human preference data, reveals the underlying reasons for human choices in large language model alignment. It...