CRAM: Centroid-Routing and Adaptive MoE for Multimodal Continual Instruction Tuning
By isolating task-specific patterns into independent modules, CRAM mitigates catastrophic forgetting across tasks and boost parameter efficiency, and utilizes adaptive-rank instantiation to identify the capability gap between existing expert capability and new task demands, and dynamically allocate only the necessary parameters.