Conference
Open access
Sep 2026
DoMoE: Domain-Aware Semantic Expert Prediction for Efficient MoE Inference Under Expert Offloading
DoMoE is proposed, a domain-aware MoE inference system that exploits domain locality in inference workloads and organizes routing information into domain-specific expert routing tables, restricts semantic matching to domain-relevant tokens and explicitly balances prediction accuracy against prediction overhead.
Yao Mu, Fa-Hao Chen, Wen-Bin Zhu et al.
· Proceedings of the Thirty-Fi... · 1 citation