Jul 2026
OrderMoE: An expert similarity driven distributed edge MoE inference
A similarity-aware expert allocation and distributed deployment framework, dubbed OrderMoE, which aims to accelerate edge MoE inference while balancing inference latency, communication overhead, server workload, and inference quality.
Xin Yuan, Ning Li, Quan Chen et al.
· arXiv.org · 2 citations