EvoCowork is introduced, a 240-task benchmark for evaluating harness-level recursive self-improvement across four office modalities, with model weights held fixed.
Zhou Liu, Xing Chen, Zhao-Yang Han et al.· 0 citations
SemanticAlign-Bench (SA-Bench), a diagnostic benchmark covering 30 papers from ICLR, ICML and NeurIPS 2025, is introduced and indicates that scaffolds optimized for executability provide limited leverage for scientific reproduction; narrowing the gap requires scaffolds that prioritize semantic specification verificatio...
Xueyan Hu, Ze-Wei Pan, Zeli Su et al.· 0 citations
ReproAgent is introduced, a four-stage Prepare--Plan--Generate--Repair pipeline built around a persistent implementation contract with two channels: an implementation-requirement channel that turns paper snippets into code obligations, and a reference-evidence channel that retrieves content and structure evidence from...
Xueyan Hu, Ze-Wei Pan, Zhongyuan Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.