DRLM: Deep Reinforcement Learning-Based LLM Query Orchestration in Edge Environments
DRLM, a Deep Reinforcement Learning-based LLM query orchestration framework in edge environments shows robust and stable orchestration, and improves latency under increasing workloads up to 61.4%, demonstrating robust and stable orchestration.