Preprint
Aug 2026
TOPAS: Workflow-Aware Prefix-State Scheduling for Multi-Agent LLM Serving
A Task-Oriented Prefix-Aware Scheduler that jointly decides which agent prefixes to keep in the cache and which requests to schedule for execution and scores candidate post-decision states by trading off the expected reduction in each task's longest remaining service path against the near-term benefit of downstream prefix reuse.
Hongqiu Ni, Han Tian, Chi Zhang et al.
· 1 citation