Concepts Whisper: Spectral Anti-Concentration and the Dual Geometry of Transformer Representations
The results suggest transformers rotate semantic content into spectrally quiet regions during contextualized processing, where, in some architectures, interventions may reduce grammatical disruption relative to high-variance steering.
Pratyush Acharya, Nuraj Rimal, H. Dhakal
· 0 citations