Gaofei Shen

Beyond Decodability: Reconstructing Language Model Representations with an Encoding Probe

The results show that the Encoding Probe provides a complementary perspective on interpreting model representations beyond decodability, and suggests that speaker-related effects vary strongly across different training objectives and datasets, while syntactic and lexical features contribute independently to reconstruct...