Preprint
Nov 2026
Introducing Cluster Efficiency to LLM Serving: Pooling Economical Accelerators over Fast Interconnects
Fast interconnects translate the per-dollar resource advantages of economical accelerators into cost-efficient long-context LLM serving, and demonstrate how low-latency, high-bandwidth interconnects enable economical accelerators to retain their cost advantage.
You-He Jiang, Pavle Glušac, Bin-Hang Yuan et al.
· 0 citations