When an image and its caption disagree, can a user reliably control which one a vision-language model (VLM) follows? Accuracy alone cannot answer this question, since a model might give the correct answer from parametric knowledge without following the requested evidence. We therefore evaluate modality grounding contro...
M. Dassen, Alexander Martin, Andrew Yates et al.· 0 citations
MultiVENT-Raw is released, a multilingual collection of nearly 120,000 primarily raw videos paired with 130 events and 222 event-centric queries, along with human-annotated video relevance judgments and human-extracted key facts for relevant videos.
Reno Kriz, David Etter, Alexander Martin et al.· 0 citations
We propose LAYERSCOPE, a label-free, layerwise framework that aims to characterize a model's learned representations in video and multimodal settings. Evaluating downstream performance using representations from final or intermediate layers typically requires large amounts of labeled data, repeated task-specific evalua...
Sandra Arcos-Holzinger, Debashish Chakraborty, Rohita Mocharla et al.· 0 citations
This work aims to explore how well vector-based pseudo relevance feedback can adapt to dense retrieval models when it is not feasible to use surface-form information to pick discriminating expansion tokens.
X. Velez, Andrew Yates, Eugene Yang et al.· Annual International ACM SIG...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.