Perception Before Supervision: Self-Contained Visual Distillation from Counterfactual Blind Spots
This work introduces CVPD (Contrastive Counterfactual Visual Process Distillation), which is the first fully self-contained framework for dense, on-policy, token-level visual self-distillation for MLLMs, and proposes a three-gate Counterfactual Criterion that identifies visual blind spots where zooming into a region changes and sharpens the model's answer distribution.