Preprint
Oct 2026
Coda: Exploiting Admission Flexibility for Coding-Agent Serving
Coding agents powered by large language models (LLMs) repeatedly alternate between model inference and tool calls, creating long-lived sessions with reusable key-value (KV) states and asynchronous request resumptions. Logical readiness, however, does not ensure efficient admission in a shared serving system. Through di...
You-He Jiang, Fang-Cheng Fu, Bin-Hang Yuan et al.
· 0 citations