The Misery of Mechanistic Interpretability: A Formal Perspective
Mechanistic interpretability has become the dominant lens for understanding frontier language models, as their inner workings are complex and inherently black boxes. To gain insights into these models, interpretable replacement networks (IRNs) are trained at all layers, exposing interpretable features through sparsely...
Tobias Ladner, Matthias Althoff
· 0 citations