This work presents MedProb, a lightweight probing framework that predicts multiple-choice Med-VQA answers from frozen VLM representations without free-text generation, and shows the probe can be extended to open-ended generation via a rejection-sampling scoring procedure.
This work presents StudentSim, a training framework that turns sparse per-student data into individualized simulators through pooled training followed by per-student specialization, and introduces StudentSimEval, a standardized protocol covering 60 students across chess, second-language English writing, and mathematics...
Ke Yang, Chenglong Wang, Michel Galley et al.· 1 citation
TRACER detects useful failure signals well before the end of the conversation and outperforms heuristic, classical, and single-stream baselines, suggesting that early failure detection can provide a practical warning signal for dialogue systems before the interaction fully breaks down.
E. Nourbakhsh, Rocky Slavin, Ke Yang et al.· SIGDIAL Conferences· 0 citations
VGI-bench is introduced, containing 27 tasks and 810 instances, organized by a two-level taxonomy of task domains and skill tags for fine-grained evaluation of visual reasoning capabilities of video generation models, and it is hoped VGI-bench will help stimulate the development of next-generation video generation mode...
Xuan He, Cong Wei, Yuhao Cheng et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.