Script Choice in LLMs: Evidence for Late-Layer Commitment
This paper investigates how script knowledge is distributed across the layers of LLMs using two complementary interpretability methods: logistic regression probing and logit-lens analysis, which show that script commitment consistently occurs at the very last layers of the LLMs.
David Kletz, Sandra Mitrovic, Itay Sabato et al.
· 0 citations