Semantic Optimal Transport for Sparse Autoencoder Feature Matching and Circuit Compression
This work introduces a distributional framework for SAE analyses, in which each feature is represented not by a single decoder vector like in the literature, but by an activation-weighted distribution over the hidden states that express it, and provides a unified semantic metric for cross-layer feature comparison.