C. Costa

Energy-Efficient LLM Inference with SLA-Constrained Adaptive GPU Power Capping

GPU energy consumption represents a primary operational cost for Large Language Model (LLM) inference services. Despite the inherent variability of production workloads, most deployments rely on static power configurations that fail to exploit the non-linear relationship between power limits and performance. Consequent...