Multi-agent debate (MAD) aims to improve large language model reasoning by exposing agents to alternative solutions and enabling iterative revision. However, standard broadcast-style MAD makes peer answers visible without requiring agents to engage with a particular peer claim. As a result, reliable reasoning may be su...
De-Zheng Bao, Si-Hang Du, Ren-Hong Huang et al.· 0 citations
RAT (RunAnyThing), a modular and extensible agent framework for fully automated configuration across programming languages on arbitrary repositories, and RATBench, a benchmark that reflects the comprehensive coverage of real-world repositories are proposed.
Renhong Huang, Dong-Dong Hua, Yifei Sun et al.· arXiv.org· 1 citation
PTCG-Bench is presented, a benchmark built on the Pok'e}mon Trading Card Game (PTCG) that evaluates LLM agents at two complementary levels: their decision-making performance within a single complex environment, and their ability to self-evolving through accumulated experience.