KVQuake: Fault Injection and Recovery Assessment for Disaggregated Large Language Model Serving
Disaggregated large language model serving introduces a recovery problem that spans request execution, remote key-value (KV) cache reuse, and service lifecycle management. A successful response does not by itself establish that the remote cache path has recovered. This report describes KVQuake, an external fault-inject...