Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Form
Language models hold latent quantities in a form they can report on, and more of a quantity is present in that form when the task requires reusing it flexibly when the task requires reusing it flexibly.