BackTrend is introduced, a retrospective benchmark in which, given a mature target topic and a temporal evidence constraint, systems must recover two types of precursors: problem-space signals, underrecognized research problems, and solution-space signals, emerging methods for known problems.
Xiao Zhou, Yi-Lun Zhao, Owen Jiang et al.· 0 citations
Evaluating frontier models on six widely used physics benchmarks and auditing them with experts suggests that current benchmarks substantially understate frontier models'ability to solve well-posed physics problems.
Ali Ansari, Hao-Ran Sun, Andy Zeyi Liu et al.· 0 citations
This work studies whether smaller language models can serve as efficient and reliable rubric-based judges, and compares three ways of extracting criterion-level judgments from small models: Generative verdicts, Yes/No Logprob margins, and Probe judges.
Feng-Yu Xie, Yilun Zhao, Bingsen Chen et al.· 0 citations
We introduce MMSciCode, a comprehensive expert-level, multilingual multi-discipline benchmark for evaluating foundation models in scientific code generation. It includes 624 expert-annotated research coding problems spanning six core scientific disciplines. Compared to prior benchmarks, MMSciCode features three key adv...
Xue Xia, Zheyuan Yang, Arman Cohan et al.· Annual Meeting of the Associ...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.