Same Outcome, Different Readout: What Does a Steerable Valence Direction in LLMs Represent?
Claims about what an internal direction in an LLM represents need evidential constraints beyond an observer's prior beliefs about the system. Decodability and successful activation steering do not, by themselves, establish which construct the direction tracks. This gap is especially consequential for welfare-relevant i...