Bridging CLIP with DINO: Cross-Modal Information Maximization for Online Test-Time Adaptation
Vision-language models such as CLIP enable zero-shot classification from arbitrary class names, but under test-time corruptions, their visual encoder projects distorted features onto incorrect textual anchors with high confidence: a phenomenon we term modality bias. Standard entropy minimization reinforces these overco...