IRIS: Internal Representation and Insight System — Sequence-Level Evidence for the Linear Representation Hypothesis and a Geometric Instrument for Alignment Monitoring
We present IRIS (Internal Representation and Insight System), a geometric instrument for observing and monitoring the internal state of language models. IRIS provides initial sequence-level empirical evidence for the linear representation hypothesis — demonstrating that the relational arrangement of tokens in activatio...