What Matters for Aggressive Decoding-Time KV Eviction? Temporal Aggregation and Ranking Preservation
Across six open-weight backbones and the LongBench, LongBench-v2, and RULER benchmarks, the results identify temporal aggregation and ranking preservation as distinct, consequential design factors; they do not imply that scoring quality is irrelevant in general.