Carbon-Aware Routing for Function Calling in Edge-Cloud LLM Systems
A carbon-aware routing framework that distributes function-calling queries across a three-tier edge-cloud architecture, combining edge and cloud LLMs on heterogeneous hardware and matches cloud-level accuracy while reducing operational carbon emissions by $4\times on average.
Aikaterini Maria Panteleaki, Varatheepan Paramanayakam, S. Tragoudas et al.
· 1 citation