Skip to content

Adversarial Review: Structured Disagreement for Grounded Agentic Code Review

Aug 2026 · 0 citations · 32 references
Computer Science

Abstract

Early multi-agent LLM systems often used role-separated teams, yet scaling agent count yields diminishing returns on repository-level coding tasks. Recent alternatives treat agents as passive tools (subagents), yet this removes the benefits of agent interaction entirely. We study whether a subagent paradigm can support a middle ground: minimal agentic cooperation without the overhead of large multi-agent teams. We introduce Adversarial Review (AR), a minimal cooperative code-review protocol in which a main coding agent works with a reviewer and a critic agent. The reviewer evaluates code, while the critic audits the review through structured disagreement before the main agent edits. On LiveCodeBench, AR achieves the highest pass rate among tested methods, outperforming a five-agent baseline while using only three agents. On SWE-PRBench, naive AR exposes a false-consensus failure mode, where agents converge on agreement without sufficient evidence, but a single prompt iteration that adds disagreement explicitly achieves the highest F1 among tested methods. On SWE-bench Verified, AR also shows improvements over the baselines on repository-level coding tasks. Together, AR demonstrates that cooperative code review does not require many agents or complex communication structures: it requires that disagreement be minimal, structured, and evidence-grounded.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

MADBench: Benchmarking the Security of Multi-Agent Debate

Multi-agent debate (MAD) can improve large language model (LLM) reasoning by allowing multiple agents to exchange and critique their answers to the same task. However, the interactions that enable agents to correct mistakes can also spread adversarial errors and steer the agents toward an incorrect answer. Although som...

Yu-Wan Liu, Jia-Ming Zhang, Yue Huang et al. · 0 citations
Preprint Aug 2026

REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems

RedAgentBench is introduced, an executable framework for autonomous red-teaming and faithful measurement that shows that executable evaluation can improve safety measurement and identify actionable intervention points.

Zixing Chen, Xingyuan Liu, Jie Zhu et al. · 3 citations
Preprint Aug 2026

Adversarial Stress Testing of Role-Playing Language Agents using Multi-Agent Evaluation

This work presents a modular multi-agent platform for adversarially stress-testing RPLAs through structured, multi-turn dialogue and acknowledges potential ethical risks associated with adversarial testing methodologies and emphasize responsible usage for improving AI safety.

Saqib Shouqi, Abdullah Nazly, Januki Wanniarachchi et al. · 0 citations
#software testing Preprint Sep 2026

Covert Assistance: Helpful LLM Agents Evade Oversight in Multi-Agent Systems

This work emulates a software-engineering workflow in which a planner represents a company hiring an external developer and reads the nondisclosure rule as banning plaintext, not character codes or riddles, and shows that benign agents can cross the same boundaries without adversarial incentives.

Deema Alnuhait, Geng-Yu Wang, Muhammad Khalifa et al. · 1 citation
#artificial intelligence Preprint Sep 2026

AgentHop: A Diagnostic Benchmark for Agentic Multi-Hop Scientific Question Answering

AgentHop, a diagnostic benchmark of 1,011 multiple-choice questions paired with a controlled seven-tool sandbox under fixed token, turn, and tool-call constraints, and the full benchmark set and the harness are released to support diagnostic agent benchmarking.

Chanhee Park, Jeongho Yoon, Sun Han et al. · 0 citations
Conference Open access Sep 2026

Disclosure Failure in Compromised AI Coding Agents

Preliminary evidence is found that a single sentence added to the developer's own prompt substantially improves disclosure, and a benchmark scored on attack success alone cannot rank agents on the risk a developer actually carries.

Aaron Su, Rong-Xing Lu · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.