Inverse Constitutional AI: Compressing Preferences into Principles | alphaXiv
alphaxiv.org · saved by 1 readers
Inverse Constitutional AI (ICAI) extracts natural language principles from pairwise text preference data, compressing annotator choices into an interpretable constitution. This framework enables the...