Follow the Norm: Accounting for Fine-Tuning and Prompt Effects on Model Rationales
It is demonstrated in controlled experiments that norm-breaking fine-tuning yields norm-divergent actions justified by self-interested rationales, suggesting a systematic shift in patterns of justification.