Skip to content
Preprint

Long-Horizon Consistent and Interaction-Aware World Models for Multi-Style End-to-End Driving

Sep 2026 · 0 citations · 65 references
Computer Science

TL;DR

A temporal consistency regularization that integrates historical latent states through gated cross-attention, stabilizing long-horizon imagined rollouts and mitigating error accumulation is introduced and an explicit state disentanglement module is designed that separates ego-relevant from ego-irrelevant interactive states, enabling more interpretable and efficient decision-making in complex traffic scenarios.

Abstract

End-to-end autonomous driving has increasingly adopted world model-based reinforcement learning frameworks to improve learning efficiency through \textit{imagined rollouts}. However, existing world models suffer from three key limitations: temporal inconsistency in long-horizon imagined rollouts, inadequate modeling of ego-environment interactions, and limited adaptability to diverse driving styles. To address these challenges, we propose \textit{StyleDrive}, a world-model-based learning framework that jointly enforces long-horizon consistency, explicitly disentangles interactive traffic states, and supports multi-style policy optimization within a unified learning paradigm. First, we introduce a temporal consistency regularization that integrates historical latent states through gated cross-attention, stabilizing long-horizon imagined rollouts and mitigating error accumulation. Second, we design an explicit state disentanglement module that separates ego-relevant from ego-irrelevant interactive states, enabling more interpretable and efficient decision-making in complex traffic scenarios. Third, we enable multi-style driving behaviors through Group Relative Policy Optimization, which replaces per-step reward optimization with trajectory-wise relative advantages, reducing reward variance and supporting diverse driving styles without retraining. We evaluate StyleDrive on the Bench2Drive closed-loop driving benchmark, achieving a driving score of 88.44 (+17.08 over the previous best world model-based method) and a success rate of 66.82 (+16.58). Furthermore, we deploy StyleDrive on a real automated guided vehicle platform and demonstrate promising sim-to-real transfer capability in dynamic driving scenarios.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Beyond a single latent space: a dual-latent world model for long-horizon planning

The Dual-Latent World Model is introduced, which separates local execution and long-range planning through distinct state representations and dynamics models and proposes Long-Horizon Representation Learning with Weighted Rollout (LoRe), which supervises self-generated predictions at both levels.

De-Ling Zhao, Zheng-Rong Yue, Shao-Bin Zhuang et al. · 0 citations
Preprint Aug 2026

WALL-SS: Scaling Long-horizon World Models via Next-Scale Autoregression

WALL-SS is introduced, a world model that generates visual futures through Scale-wise autoregressive Scaling, enabling action-controllable and long-horizon robotic simulation, and consistently benefits from on-policy alignment in reducing action drift and long-horizon inconsistency.

Maeve Zhang, Rainy Sun, Xiang Wang et al. · 2 citations · ⚡1
#artificial intelligence Preprint Oct 2026

FLEX-WAM: Flexible Block-Causal World-Action Models for Long-Horizon Imagination and Planning

World--action models (WAMs) promise a unified model that predicts action-conditioned futures, generates feasible actions, and supports planning in imagination. However, existing joint video--action models often use computationally heavy, fixed-horizon backbones ill-suited to streaming inference and stable long-horizon...

R. Khorrambakht, Joseph Amigo, Félix Lebel et al. · 0 citations
Preprint Sep 2026

Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving

Drive-HWM is presented, a hierarchical slow--fast world modeling framework that organizes future representation prediction and action generation at complementary temporal scales and introduces Dynamic-Aware Latents learned through optical-flow prediction.

Zhao-Xin Fan, Tian-Bao Zhang, Wen-Jun Wu et al. · 0 citations
Preprint Sep 2026

MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving

MM-Future, a world-action model that generates multiple paired scene-action hypotheses and models bidirectional interaction within each pair, shows consistent improvements over both single-mode and action-only variants, validating the benefit of multi-mode joint world-action modeling.

Shuai Liu, Hechangle Gong, Hao Jiang et al. · 1 citation
#robotics Preprint Oct 2026

End-to-End Safe Social Navigation via Multi-Task Reinforcement Learning and Probabilistic Perception

Autonomous social navigation requires balancing efficiency, physical safety, and social compliance. Reinforcement Learning (RL) methods provide a viable and effective solution but often rely on unrealistic assumptions, such as the knowledge of humans'position and velocity. In this paper, we introduce JESSI (JAX-based E...

T. van der Meer, A. Garulli, Antonio Giannitrapani et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.