Uncore Frequency De-Tuning for Power Efficient LLMs at Telco Edge
A key pillar of the evolving telco cloud landscape is the potential hosting of AI workloads such as Large Language Model (LLM) inferencing instances. While Graphics Processing Units (GPUs) are often favoured for best possible performance, it is also feasible to run certain LLM models on more standard Central Processing...