Epiphany-Aware KV Cache Eviction Without the Attention Matrix
EpiKV is introduced, which combines hidden-state shifts with the model's recent query--key relevance to rank cached tokens without materializing the attention matrix, and matches or outperforms the strongest attention-based eviction baselines while running directly in vLLM with unmodified attention kernels.