Author

R. Chauhan

h-index 0 View on Semantic Scholar

We have 1 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

Through the Bottleneck: How Multi-head Latent Attention Separates Content from Position in Language Models

This work presents the first comprehensive mechanistic interpretability study of MLA, training a 114M-parameter transformer and analyzing its representations through SVD, attention head taxonomy, linear probing, and a disruption-attribution analysis.

S. Dhruvil, Fenil Sojitra, R. Chauhan · arXiv.org · 0 citations