Marko Jojic

Don't Just Look, Intervene: Perturbation Based Region Labeling for VQA Images

Vision Language Models (VLMs) should rely on visual evidence that directly determines the correct answer, but supervision for grounding visual reasoning is often expensive to obtain manually or tied to dataset-specific annotation primitives. We instead introduce model-causal visual evidence as an annotation target, def...