Ivan Slobozhan

Cross-Modal Forgetting and Transfer in Unified Multimodal Post-Training

Unified multimodal models answer questions about images and also generate images with one shared set of weights. This creates a post-training risk that single-purpose models do not have: fine-tuning one capability can damage another that works in a different modality. We measure this cross-modal forgetting for LoRA pos...