Jul 2026
MoX: Efficient MoE Routing on Direct-Connect Topologies
This work shows that efficient offline-optimized routing enables efficient MoE training and inference on direct-connect topologies without the need for MoE traffic matrix or dynamic topology reconfiguration.
Ori Cohen, Jakob Krebs, Daniel Amir et al.
· arXiv.org · 0 citations