Routing Should Pay for Itself: Sparse Supervision for Economical LLM Routing
Large language model (LLM) routing reduces serving cost by assigning each query to an appropriate model while preserving response quality. Learning such a router, however, often requires executing multiple candidate models on historical queries to collect query--model quality feedback, creating a nontrivial supervision...
Guannan Lai, Ge-Lin Bian, Hao-Xuan Ma et al.
· 0 citations