SwarmBench: Can Large Language Models Act as Agent Swarm Orchestrators?
SwarmBench is proposed, a benchmark that evaluates model performance from multiple perspectives, including accuracy, efficiency, cost, and process quality, and SwarmExp is proposed, a simple yet effective method based on experience extraction and experience replay, which consistently improves the orchestration performance of large language models.
Jin Gao, Zhuoran Jin, Tianyi Men et al.
· 0 citations