Measuring the Assistant's Harmlessness Preferences on the User Turn
Post-training turns a general next-token predictor into a chat model with a persistent assistant persona. If that persona is a character the model plays only on its own turns, its preferences should govern what the assistant says, not what the model predicts other speakers will say. We test this boundary and find that...
Jord Nguyen
· 0 citations