Preprint
Oct 2026
Cache Engineering for Agents
Large Language Model (LLM) agents can handle increasingly complex tasks, navigating long trajectories of observations and actions. As these trajectories grow, key-value (KV) cache I/O and storage become the dominant cost. Trajectories can also exceed the LLM's maximum context length, requiring control over active cache...
Tianyu Fu, Ruo-Xin Wang, Zi-Han Min et al.
· 0 citations