Skip to content
Preprint

An Actionable Diagnosis of Multilingual, Multi-Agent Planning Failures

Aug 2026 · 0 citations · 90 references
Computer Science

TL;DR

To test whether the taxonomy supports mitigation, TART, Taxonomy-Guided Actionable Representation, is introduced that makes the taxonomy's key aspects explicit to the planner and downstream sub-agents and consistently improves performance.

Abstract

Multilingual multi-agent systems exhibit substantial degradation beyond English, yet prior work rarely identifies how task-critical information is lost when user requests are converted into executable plans. We study the planner in a multi-agent system as the request-to-action interface and derive an actionable taxonomy of planning-grounding failures from failed real-world task executions. LLM-based analysis shows that these failures constitute an increasing share of unsuccessful executions as language-resource availability declines, with the strongest effects in low-resource languages. To test whether the taxonomy supports mitigation, we introduce TART, Taxonomy-Guided Actionable Representation, that makes the taxonomy's key aspects explicit to the planner and downstream sub-agents. Across multiple languages, three LLM backbones, two datasets, and two agentic configurations, TART consistently improves performance. On multilingual GAIA, it raises a state-of-the-art system's accuracy by 5.6 percentage points averaged across eleven languages spanning low- to high-resource settings.

View source

Similar papers

Preprint Jul 2026

Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems

Experimental results show that AgentLocate consistently outperforms existing failure localization methods in identifying both responsible agents and failure steps, while remaining efficient in terms of token usage and running time.

Yu Xia, Anjun Gao, Yueyang Quan et al. · 0 citations
Preprint Jul 2026

Beyond the Leaderboard: A Synthesis of Tool-Use, Planning, and Reasoning Failures in Large Language Model Agents

This paper synthesizes 27 benchmark, taxonomy, and audit papers (2023-2026), spanning 19 distinct benchmarks, into a cross-cutting taxonomy of agent limitations, the first synthesis that integrates evidence across tool use, planning, long-horizon reasoning, multi-agent coordination, safety, and measurement validity int...

Wael S. Albayaydh, Rui Zhao, Ivan Flechais · 1 citation
Jul 2026

Otap:Structure-Aware Optimal Transport for Evaluating Planning and Execution in Agent Trajectories

This work reframe trajectory evaluation as a distance between the agent's execution graph and a set of valid solution graphs, and instantiates OTAP via an unbalanced fused Gromov-Wasserstein transport problem over attributed dependency graphs, which is a pseudo-metric that is provably invariant to dependency-preserving...

Babak Barazandeh, Subhabrata Majumdar, G. Michailidis · 0 citations
Preprint Aug 2026

ExRole: From Team Trajectories to Executable Roles in Multi-Agent Language Models

ExRole is introduced, a trajectory-to-role framework that learns future-aware role prototypes from prefix-local team traces, resolves them into readable instructions and token-aligned role markers, and optionally routes shared LoRA rank slots with turn-aligned credit.

Zhou Liu, Chaoyang Han, Ze-Wei Pan et al. · 0 citations
Preprint Jul 2026

Decision Protocols in Multi-Agent Large Language Model Conversations

This thesis introduces the Multi-Agent LLM (MALLM) framework, which implements and evaluates various decision protocols, namely voting, consensus, and judge decision mechanisms, to simulate multi-agent discussions for conversational task solving and indicates that consensus protocols excel in knowledge-intensive domain...

Lars Benedikt Kaesberg · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.