Stephen Casper

From Constitutions to Control: Interpretable Rewards for Aligning Language Models

Current approaches to aligning language models often make it hard to know what behavior is being rewarded or to change that reward in a targeted way. In particular, standard preference-based methods collapse multiple considerations into aggregate human judgments, obscuring what drives the resulting reward, while princi...