Low-Resource Preference Adaptation of LLMs via Activation-Based Label Propagation
This paper investigates how language models encode preference information in their intermediate representations, finding that activations from chosen and rejected responses form distinct clusters across layers, even in pretrained models.
Alessio Galatolo, Meriem Beloucif
· 0 citations