MigMoE: Task-Aware Expert Migration for Faster and More Balanced Expert-Parallel MoE Inference
Motivated by the observation that routing patterns are task-specific, MigMoE is proposed, a task-aware expert migration framework that dynamically adjusts expert placement for multi-task expert parallel MoE inference to balance loads across GPUs.