What Tokens Truly Matter? The Logit Conflation Problem in LLM Sampling
TL;DR
This work identifies the Logit Conflation Problem, where a to-ken’s logit aggregates prompt-independent factors, including linguistic fluency and parametric associations, with prompt-relevance, and proposes SEAL-Sampling to isolate this component through attention-weighted attribution.
Abstract
Sampling methods for large language models select candidate tokens based on logit statistics, implicitly assuming that high log-its indicate desirable outputs. We identify the Logit Conflation Problem , where a to-ken’s logit aggregates prompt-independent factors, including linguistic fluency and parametric associations, with prompt-relevance. However, only prompt-relevance determines instruction-following quality. We propose SEAL-Sampling ( S ignal E xtraction for A ctive Re L evance) to isolate this component through attention-weighted attribution. Our framework defines prompt-relevance as the causal effect of prompt content on token logits and establishes attention patterns as an efficient proxy. Experiments on LLaMA-3 demonstrate significant improvements over top-nσ , with gains of 1.8% on AlpacaEval 2.0 and 2.2% on IFEval. Furthermore, attribution scores correlate weakly with raw logits, confirming the extraction of an orthogonal signal. The method is training-free and introduces minimal latency, adding less than 12ms overhead per token.