Online LLM Inference Routing for Multi-Agent Systems under Long-Term Budget and Layered Privacy Constraints
The Cloud-Edge-End (CEE) collaborative architecture has become a key paradigm for deploying highly intelligent multi-agent systems with low latency and high energy efficiency. Existing studies on efficient task offloading in CEE, however, either overlook long-term financial budget constraints from commercial API to...