Yi-Liang Guo

Boosting LLM Serving in Computility Networks Via a Publish-Subscribe Framework

Computility Network (CNet) represents an emerging paradigm that integrates heterogeneous, widely distributed, and cross-domain computing resources into an elastic infrastructure. The rapid deployment of Large Language Models (LLMs) in a CNet has introduced significant challenges in optimizing serving latency and maximi...