Lisiane Pruinelli

Weights Read and Write Features: Scalable Parameter Decomposition Grounded in Activation Space

Activation space and parameter space provide complementary views of model computation. Activations represent information, while weights read, transform, and write that information. Yet existing interpretability methods largely study the two spaces separately, leaving the connection between represented information and p...