RuVerBench is introduced, the first benchmark for assessing LaaJ reliability in rubric verification for agentic scenarios, and the impact of key LaaJ strategies, including prompt design, batching, and majority voting, on rubric verification is analyzed.
This work introduces RepoProbe, a novel benchmark for evaluating repository-level code understanding through open-ended Q&A using GitHub Discussions, which focuses on open-ended architectural inquiries rather than defect reporting and proposes a Checklist-Based Verification Protocol that decomposes answers into atomic,...
Skill-Use is introduced, a benchmark that evaluates skill use under progressive disclosure, where an agent sees only a skill's name and short description and must retrieve the full procedure before following it.
Internal short-circuit (ISC) faults in lithium-ion batteries shorten service life and may cause severe safety issues such as thermal runaway. Therefore, this study proposes a purely data-driven method based on terminal voltage during charging. The analysis focuses on the stable mid-to-late stage of low-rate constant-cu...
S. Duan, Yizhen Qu, Ye Liu et al.· Engineering Research Express· 0 citations
TrajDebug is proposed, an error-lifecycle tracing framework that addresses long-trajectory error discovery with multi-granularity history compression and evidence-based error identification, and supports critical attribution by tracing each error's resolution status and terminal impact.
Yunjia Qi, Zehua Yin, Xin Shi et al.· 4 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.