Preprint
Oct 2026
Zepp: Accelerating Distributed MoE Serving under Relaxed Balance Constraints
As Mixture-of-Experts (MoE) models continue to scale, serving them increasingly relies on expert parallelism (EP) across a growing number of devices. Yet skewed expert workloads create imbalance across computation, communication, and memory, making load balancing a central optimization objective in distributed MoE serv...
Chang Chen, Andrew Yang, Tian-Cheng Chen et al.
· 0 citations