HeadEdit: Calibrating Language Model Behavior Through the Frozen Unembedding Matrix
Alignment does not eliminate behavioral errors in language models. Models may still refuse benign requests, call unnecessary tools, or yield to false user claims. Current methods mitigate such errors as a computation problem, and rarely explore if the desired behavior is already encoded in the model's representation. M...
Zirui He, Hai-Yan Zhao, Jing-Yu Hu et al.
· 0 citations