Skip to content
Preprint

UrbanAgent: A Tool-Augmented Agent for Cross-System Urban Tasks

Aug 2026 · 0 citations · 23 references
Computer Science

TL;DR

This work proposes Urban-Agent, a tool-augmented agent framework for cross-system urban tasks that couples the cognitive and reasoning capabilities of a large language model with a tool-set supporting code execution, API calls, and Model Context Protocol.

Abstract

Modern cities rely on an increasing number of digital services to operate, but residents'daily needs are still difficult to meet. Services are fragmented and have little interoperability, placing a heavy operational burden on users. Existing digital platforms, urban foundation models, and intelligent assistants each address only isolated aspects of an urban task. But they struggle to reliably convert complex natural-language requests into executable cross-system workflows. We propose Urban-Agent, a tool-augmented agent framework for cross-system urban tasks. It couples the cognitive and reasoning capabilities of a large language model with a tool-set supporting code execution, API calls, and Model Context Protocol. Through one adaptive closed loop, it clarifies missing information before acting, grounds tool use in live observations, and aligns the final response with observed evidence and task constraints. To address the evaluation gap, we introduce Urban-Eval, a benchmark specifically designed for cross-system urban request. Unlike prior benchmarks that assess either general tool use or urban knowledge and reasoning, Urban-Eval evaluates both task results and execution quality, including required tool coverage, dependency validity, and evidence traceability. Experimental results indicate that Urban-Agent reaches a 71% task success rate, 10 points above the strongest baseline. This lead holds across GPT-5-mini, Gemini-2.5-flash, DeepSeek-V4-flash, and Qwen3-235B-A22B.

View source

Similar papers

Preprint Aug 2026

Lingjing: A Simulation Testbed for Multi-Agent Embodied Tasks in Open-Ended Cities

Lingjing provides a unified testbed that enables reproducible end-to-end evaluation and systematic failure diagnosis in urban multi-agent embodied intelligence and exposes shared physical and structured urban state to agents.

Xiaohe Li, Yi-Ru Wang, Junhao Fan et al. · 0 citations
Preprint Aug 2026

DuMateBench: Evaluating Autonomous Agents in Complex Real-World Workflows

DuMateBench, a real-session benchmark reconstructed from anonymized and privacy-screened user sessions collected from a large-scale production agent platform, is introduced, showing that performance under environmental perturbations is jointly shaped by the capabilities of the LLM and the surrounding agent framework.

Zechun Niu, Yu-Kun Zhao, Jia-Xin Zhang et al. · 1 citation
#artificial intelligence Preprint Sep 2026

ERPBench: A State-Grounded Evaluation Paradigm for Computer-Use Agents in Enterprise Software

ERPBench is introduced, a benchmark that evaluates screenshot-only agents on a live and reproducible system and scores each task against ground-truth values in its database and presents a production-grade harness that gates agent actions behind human approval for safe deployment.

Kratika Bhagtani, K. Sridhar, M. B. Pouyan et al. · 1 citation
#artificial intelligence Preprint Sep 2026

AURORA: A Natural Language-Driven Agentic Framework for Understanding, Reasoning, and Orchestrating Reliable Air-Ground Co-Simulation

The results show that reliable scenario generation requires verifying realized behavior, not merely executable code, and demonstrate the value of explicit intermediate representations for verifiable and repairable language-driven co-simulation.

Keshu Wu, Hao Zhang, Rui Gan et al. · 0 citations
#artificial intelligence Preprint Sep 2026

CityPlanner: A Sandbox Agent for Executable Urban Planning

CityPlanner is proposed, a sandbox-agent framework for executable urban planning that consistently outperforms heuristic, task-specific RL, and general LLM-agent baselines and is verified on a real-world benchmark.

Wen-Tao Zhang, Jing-Yuan Wang, Ze-Tong Zhou et al. · 0 citations
Preprint Aug 2026

Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation

Evaluating language-guided mobile agents has recently shifted from rule-based to model-based approaches to achieve scalable and automated assessments. However, existing holistic evaluation paradigms process entire trajectories at once, leading to substantial context overload. Moreover, they primarily focus on task comp...

Peng-Jian Yang, Zijing Gao, Xue Yu et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.