Agent evaluation harnesses are software systems that run test suites, generate inputs, and decide outcomes with test oracles. This paper audits such software for reliability defects that score tables cannot reveal. We introduce an oracle-integrity auditing approach with five state-integrity invariants and three known-a...
This work proposes GSE, a globalized skill evolution framework that jointly optimizes skill compatibility and skill generalization, and maintains a Skill Relation Graph (SRG) that explicitly models and co-evolves inter-skill relationships.
Chen Yang, Jiashuo Tian, Zi-Qi Wang et al.· 3 citations· ⚡1
AssertMate is proposed, a novel agent-based assertion generation framework that enhances the quality and reliability of LLM-generated assertions through three key components: actual value construction that identifies assertion targets via static analysis and type-aware heuristics, and multi-perspective expected value p...
Dong Wang, Qiaoyu Han, Lin Yang et al.· 0 citations
JavaOracle is proposed, a specification-driven approach that leverages large language models to reason over specifications and systematically enhance test oracles and further automates test case minimization and bug report generation, producing submission-ready reports without manual effort.
Ruifeng Fu, Yingquan Zhao, Meng Wang et al.· SIGSOFT FSE Companion· 0 citations
It is shown that fuzzing-generated crashes can meaningfully improve agent robustness and enable accurate safety monitoring with strong cross-method generalization, and the benefits of combining complementary fuzzing strategies and adopting multi-level diversity analysis to achieve more comprehensive and practical RL te...
Zhibin Kang, Hanmo You, Dong Wang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
