H. B. Acharya

Disaggregated LLM KV-Cache Storage Requires Coordination-Free Consistency Abstractions

An available KV-cache hit is not always a safe decoder hit. A miss loses reuse; an invalid commit can silently perturb decoder output. In a disaggregated cache, a replica may know where a block was placed, but retirement, allocation reuse, and reader lifetimes evolve elsewhere. We use the CALM monotonicity criterion to...