Contiguity, Not Importance: Budgeted Repair of Stale KV Caches After Document Edits
The results support unconditional edit-local repair when the dependent text remains adjacent to the edit, and repair is 13-21 times faster than full re-prefill.
Ming-Yang Mao, Wyatt Mackey, Xiao-Min Lin
· 0 citations