Joint Policy and Prompt Optimization (P O) is introduced to mitigate advantage collapse by alternating continuous policy updates with discrete prompt evolution, providing a self-reinforcing framework that facilitates more effective LLM alignment.
Xinyu Lu, Kaiqi Zhang, Jing-Li Yang et al.· arXiv.org· 2 citations
Inspired by the human cognitive planning process, HintNav-igator achieves state-of-the-art performance among open-source LLM agents, surpassing proprietary model Claude-3.5 Sonnet on the WebArena benchmark.
Guozhao Mo, Yan-Jiang Liu, Yafei Shi et al.· 0 citations
The first large-scale empirical study of SE skills in public repositories and marketplaces provides the first activity-centric characterization of SE skills and reveals how SE activities are increasingly being transformed into reusable skills.
DocOps is introduced, a deterministically verifiable evaluation framework underpinned by a hierarchical taxonomy that deconstructs document operations inspired by real-world practices into atomic dimensions and escalating workflow complexities that exposes the capability boundaries of agents in maintaining global docum...
Jiazhen Jiang, Boxi Cao, Lingyong Yan et al.· arXiv.org· 1 citation
Results support treating PHD as a distinct target for evaluating how LLMs formulate investigative directions when final conclusions are withheld, with gains for several lower-performing models on HypoArena but regressions for other systems, including a top-performing model.
Tianyun Zhong, Wangyi Jiang, Wei Wang et al.· arXiv.org· 0 citations
A short-to-long OPD schedule that detects teacher-confirmed repetitive suffixes, treats the surviving prefix as each rollout's effective length, and allocates future rollout budgets to the effective lengths the policy can currently use is proposed.
Qingyu Zhang, Qianhao Yuan, Hongyu Lin et al.· 5 citations
Experimental results show that RUPA consistently outperforms existing UQ methods by providing more accurate uncertainty estimates, enabling earlier failure detection, and improving uncertainty-guided agent execution across diverse agent tasks.
Zheng Ma, Boxi Cao, Yaojie Lu et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.