Book
Open access
Sep 2026
Token Write Amplification in LLM-Mediated State Stores
LLM-based applications increasingly rely on persistent state stores to maintain durable memories across long-running interactions. Unlike conventional storage systems, these stores often invoke LLMs on the write path to transform raw context into semantic state, shifting maintenance cost from bytes written to tokens pr...
Shi-Jun Yang, Shu-Heng Gao, Chao Yan et al.
· Proceedings of the 18th ACM... · 0 citations