Attention as Conditioning: What Classical Learning Theory Predicts About Linear Transformers
PH-attention is introduced, a Pearce--Hall-inspired rule with an explicit feature-indexed associability state that yields cue-dependent learning rates and is absent from the token-computed gates the authors compare, and predicts a dissociation that survives training on generic in-context association.
Mu Qiao
· 1 citation