S. Heimersheim

Individual Parameters in Weight-Sparse Transformers Appear Interpretable

This work introduces an automated LLM pipeline that writes a short, human-readable description of when a weight matters and verifies it on held-out text, crediting a weight only if its description generalizes.