Evaluating the Causal Faithfulness of SHAP as a Candidate Attribution Method for SAE Features
Sparse autoencoders decompose language model representations into interpretable features, but feature interpretation in this literature remains predominantly correlational. Attribution methods offer more direct estimates of feature influence, yet their faithfulness to actual causal effects has not been systematically e...