Measured Joules, Learned Routes: Learning to Route for Energy-Efficient LLM Serving
Results demonstrate that learned routing can selectively allocate expensive model capacity based on query context and improve the accuracy-energy tradeoff in multi-LLM serving.