QREF, a plug-and-play Query Refiner and Evidence Filter that rewrites search queries according to the current reasoning intent while ensuring complementary coverage across each search batch, improves the performance of DeepSearch agents across four challenging benchmarks.
Yu-Jian Chen, Yu-Hui Wang, Jun-Zhe Wang et al.· 0 citations
ExplorationBench turns the wicked problem of evaluating scientific exploration into a concrete and tractable framework built on verifiable Alien Worlds, and finds that the strongest systems can acquire and apply unfamiliar rules, while performance varies substantially across trajectories and continued exploration can s...
Ming Zhang, Zhen Xiang, Pei-Zhong Gao et al.· 0 citations
MuseCritic is introduced, a semi-scalar reward model that generates a natural-language critique covering five aesthetic dimensions and uses it as an intermediate representation to predict continuous reward scores, showing that critique-conditioned reward modeling reduces scoring error and provides an effective optimiza...
Jiabao Zhuang, Changhao Jiang, Hanchen Wang et al.· 0 citations
SPIEval is introduced, a human-curated benchmark grounded in five cognitive capabilities that exposes fundamental limitations of current LLM-based mobile assistants and motivates future research in this direction.
Junjie Ye, Zhuohui Sheng, Shao-Hua Liu et al.· 0 citations
NovGauge is presented, a human-anchored benchmark for fine-grained novelty assessment diagnosis, and a cascading diagnostic pipeline that verifies per-dimension correctness, evidence grounding, and logical support is proposed.
Guo-Qiang Zhang, Ke-Xin Tan, Ming Zhang et al.· 0 citations
A novel textual representation of fault trees is proposed, and a benchmark for multi-turn dialogue systems that emphasizes robust interaction in complex environments is constructed, evaluating a model's ability to assist in malfunction localization.
Yuhui Wang, Zhi-Xiong Yang, Ming Zhang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.