Learning When to Trust and Reobserve Sparse-Frame VideoQA from Temporal Sampling Perturbations
Sparse-frame video-language models can change their answers when only the sampling timestamps shift. Raw agreement exposes this problem, but it need not rank errors better than token confidence or identify which additional observation will repair an answer. We argue that answer risk and action value must be estimated s...