Grounding on Request: Learning Modality Control in Vision-Language Models
When an image and its caption disagree, can a user reliably control which one a vision-language model (VLM) follows? Accuracy alone cannot answer this question, since a model might give the correct answer from parametric knowledge without following the requested evidence. We therefore evaluate modality grounding contro...
M. Dassen, Alexander Martin, Andrew Yates et al.
· 0 citations