Matt Gorbett

Ventriloquist LLMs: Linear Alignment of Late-Stage Representations

This work learns affine transformations between the final hidden states of independent models and evaluates them across embedding classification, out-of-distribution detection, and autoregressive text generation, finding that success is governed by two factors: tokenizer overlap, which correlates strongly with generati...