Searching for Emergent Geometric Coordinate Systems in LLM Hidden Representations: A Replication Attempt
This is a mechanistic-interpretability replication attempt testing whether large language models (Qwen2.5-0.5B, Mistral-7B-v0.1) encode small closed relational sets, such as days of the week and months, as literal low-dimensional geometry in hidden-activation space, via a graph-Laplacian probe. We report six results, i...