Coding-agent evaluation has progressed from resolving individual issues to carrying out long-horizon development, yet task completion is still largely assessed within a single codebase. In software ecosystems, many features and bug fixes require coordinated changes across multiple repositories. We introduce WideSWE to...
Bao-Yi Wang, Xing-Liang Wang, Jin-Yang Wu et al.· 0 citations
A memory-free recent-window protocol is fixed and a transparent and reproducible reference for open-source streaming-video research is provided, combining verifiable streaming-video data, thinking-mode OPD, and instruct-mode deployment.
Keming Wu, Baoyi Wang, Kai-Chen Zhang et al.· 0 citations
VGI-bench is introduced, containing 27 tasks and 810 instances, organized by a two-level taxonomy of task domains and skill tags for fine-grained evaluation of visual reasoning capabilities of video generation models, and it is hoped VGI-bench will help stimulate the development of next-generation video generation mode...
Xuan He, Cong Wei, Yuhao Cheng et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.