Preprint
Aug 2026
Sparse Weight Decomposition for Efficient Circuit Extraction
Sparse Weight Decomposition is proposed, which reparameterizes pretrained linear projections by factorizing each weight matrix into two sparse factors whose shared intermediate coordinates serve as individually addressable circuit units.
Chuanhao Yan, Xuhan Huang, Yawen Duan et al.
· 1 citation