Measured Joules, Learned Routes: Learning to Route for Energy-Efficient LLM Serving
Results demonstrate that learned routing can selectively allocate expensive model capacity based on query context and improve the accuracy-energy tradeoff in multi-LLM serving.
Muhammad Abdur Rab Siddiqui, Daniel Rojas, Chen Yang et al.
· 0 citations