Monarch-MoE: Structured Experts for Multimodal Continual Instruction Tuning
Learning new tasks in multimodal continual instruction tuning can cause catastrophic forgetting of previously acquired knowledge. Although multi-expert LoRA distributes learning across experts, updates to a dense low-rank expert can still affect many output features. We introduce Monarch-MoE, which replaces the dense f...
Xi Zhang, Bo-Yu Diao, Ze-Sen Chen et al.
· 0 citations