Skip to content

Dual-Frontier: When Can an Agent Trust Its World Model?

Sep 2026 · 1 citation · 42 references
Computer Science

TL;DR

Dual-Frontier, a learning principle that admits a world-model-guided decision only when its predicted advantage exceeds a certified bound on decision-relevant world-model error; otherwise, evidence is allocated to world-model verification.

Abstract

Learned world models are becoming essential to general-purpose agents: by predicting action consequences, they support planning and decision-making while reducing reliance on costly trial and error. This reliance creates a fundamental ambiguity: when a world-model-guided decision fails, the trajectory alone may not reveal whether the agent's decision rule or the world model caused the loss. We formalize this failure-attribution problem as a counterfactual decomposition of return loss and prove that its components are not identifiable from passive interaction, even for finite-horizon planners. This obstruction motivates Dual-Frontier, a learning principle that admits a world-model-guided decision only when its predicted advantage exceeds a certified bound on decision-relevant world-model error; otherwise, evidence is allocated to world-model verification. Action-conditioned value bounds and a closed-loop extension guarantee non-decreasing return for admitted decisions. Calibrated gates and simultaneous confidence sequences support adaptive evidence reuse, with sufficient and necessary verification bounds. Controlled learned-model experiments validate the predicted failure modes and certification behavior, while cross-backbone tool-use benchmarks instantiate the same verify-then-promote rule in realistic agent world-model pipelines, consistently improving decision quality and reliability.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Belief-Calibrated Optimization: An Explicit World Model for Agentic Optimization

Belief-Calibrated Optimization is introduced, a method that writes that belief down as a persistent in-context document and continually revises that document as new candidates are evaluated, and reaches a higher train passrate than a matched control that lacks only the world model.

Yu-Han Chen, Zhi-Hua Tian, Mahavir Dabas et al. · 1 citation
Preprint Aug 2026

Quantifying Risk Under Evolving Uncertainty: Belief-Dependent Robustness for Safe Sequential Decision Making

RATTL targets runtime safety for agents, including LLM-based systems, acting under uncertainty, and proves a Safety Sandwich: the RATTL value lies between the uninformed robust value and the full- knowledge optimum, with a gap that vanishes as the posterior concentrates.

D. Ganguly, Jan Křetinský · 0 citations
Preprint Aug 2026

Knowing When to Ask for Help: Bayesian Self-Escalation in Hierarchical LLM Agents

The myopic escalation threshold is derived in closed form, characterise the optimal policy via dynamic programming, and it is proved that the optimal policy is a time-varying threshold with no shape assumption on the raw signal.

Nadeem Shaikh · 1 citation
#artificial intelligence Preprint Sep 2026

Do Frontier Models Seek Safety Evidence Before Acting?

SAFE, a controlled benchmark in which models make deployment decisions with optional evidence that varies in retrieval cost, probability, severity, and presentation, is introduced and suggests that deployment-time safety depends not only on how models respond to known risks, but also on whether they acquire the evidenc...

Omer Tafveez · 0 citations
Preprint Sep 2026

The Missing Boundary: How Autonomous Agents Lose Control

Autonomous agents increasingly perform long-horizon tasks involving tool use, persistent state, and consequential actions, raising a fundamental question: \emph{under what conditions does an agent cross the boundary of authorized execution while pursuing a legitimate task?} Existing studies often attribute such failure...

Zong-Hao Ying, Xiang-Fan Wu, Bo Yang et al. · 1 citation · ⚡1
#artificial intelligence Preprint Sep 2026

Rethinking World Models for Safety-Critical Embodied Systems

It is argued that future world models should move beyond predicting likely futures toward identifying which futures matter, revising judgments through experience, and recognizing when to act, revise, sense, defer, or abstain.

Kai-Lang Ma, Heyang Huang, Inhi Kim et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.