Open access
Aug 2026
Janus: Joint Prefill/Decode Disaggregation with KV-Cache-Aware Multi-Cloud Routing for Edge-Adjacent LLM Serving
Janus is, to the authors' knowledge, the first scheduler to treat the KV-transport decision as a first-class scheduling variable jointly with prefill and decode routing across heterogeneous multi-cloud fleets, with provable guarantees.
K. Aruna, V. Kaliraj, I. Sudha et al.
· EAI Endorsed Transactions on... · 0 citations