Skip to content
Preprint

LAW: Unifying Language, Action, and World Modeling for Agentic Physical Intelligence

Oct 2026 · 0 citations · 55 references
Computer Science

TL;DR

LAW, a closed-loop VLM--WAM framework that unifies language reasoning, action generation, and world modeling through semantic subtask progress, is presented, establishing a new open-source state of the art on RoboTwin.

Abstract

World-action models jointly predict actions and future world states, but long-horizon manipulation further requires language reasoning to plan subtask objectives, assess execution progress, and guide action selection. We present LAW, a closed-loop VLM--WAM framework that unifies language reasoning, action generation, and world modeling through semantic subtask progress. Within the LAW agent, a hybrid-expert vision-language model plans the remaining subtasks, estimates the values of and fuses actions proposed by a world-action model, and asynchronously assesses execution status to support continued execution and subtask transitions. Within the world-action model, Mixture-of-Transformer Experts integrates modality-specific and shared computation for joint video--action modeling. Dual-stream hierarchical visual memory maintains temporal context for both models, while subtask-local value learning aligns action evaluation with semantic objectives and preserves supervision from successful prefixes of failed trajectories. LAW achieves 94.21% average success across 50 RoboTwin tasks. Replacing the WAM backbone with OpenWAM-$alpha$ further raises the average success rate to 95.56%, establishing a new open-source state of the art on RoboTwin. Despite having only 2B parameters, our VLM also outperforms variants using Embodied-R1.5 and GPT-5.5 High. On three long-horizon real-robot tasks, LAW achieves 65% average success, compared with 28.33% for $pi_{0.5}$ and 25% for Fast-WAM.

View source

Similar papers

Preprint Oct 2026

Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation

Long-horizon compositional manipulation has become increasingly important for real-world robot deployment, where a single task involves multiple coordinated subtasks. Existing world-action models (WAMs) jointly predict short-horizon visual futures and actions, but typically lack explicit subtask-level reasoning. We pro...

Shu-Kai Gong, Xuan-Ran Zhai, Yintianrun Zhang et al. · 0 citations
Preprint Sep 2026

EmbodiedSkills: World Action Model-augmented Cascaded Skills for Vision-Language-Action Agent

EmbodiedSkills is presented, a skill-based agent framework that augments frozen VLA policies with world action models for consequence-aware action selection and demonstrates the applicability of consequence-aware selection across different policy backends and action representations.

Wei Wang, Wen-Qiao Zhang, Yu-Tong Lin et al. · 2 citations
#artificial intelligence Preprint Oct 2026

UniWALM: Unified World Action Language Model for Embodied Robot Control

Motivated by the human ability to integrate experience across language, perception, and action, we introduce UniWALM, a unified world-action-language model that learns video, action, and language in a single shared representation, where each modality is both a conditioning signal and a supervision target. We ask: can j...

Rahul Sajnani, D. Romeres, Ming-Yuan Zhang et al. · 0 citations
Preprint Oct 2026

Agentic World Action Models

Recent world action models provide visual foresight and future prediction for robot manipulation, but lack explicit mechanisms for compositional skill reuse. Agentic robotics combines code-based planning and reasoning with reusable skills, but often lacks predictive grounding in physical dynamics. We introduce AW-0, an...

Zhuo-Yang Liu, Dan-Tong Niu, Bo-Tong Zhang et al. · 0 citations
Review Sep 2026

World-Action Models for Robot Learning and Control: A Survey

Robots operating in open environments act under partial observability, physical constraints, and dynamic task contexts. Beyond mapping observations and language instructions to actions, they must anticipate how candidate actions may affect future states and task-relevant outcomes. Recent advances in world models, video...

Zu-Xing Lu, Hong-Jia Zhai, Guan-Zhi Wang et al. · 4 citations
#artificial intelligence Preprint Oct 2026

Beyond Actions: Learning Future Operation Targets for Vision-Language-Action Models

Actions specify what a robot should execute, but do not describe what those commands will achieve. Vision-language-action (VLA) policies nevertheless learn primarily by predicting action chunks from images, language, and state. We introduce Action--Future Coupled Effect Learning (AFCE), which makes a future-grounded ph...

Min Lin, Bo-Kai Zhou, Jian-Qi Lin et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.