A temporal consistency regularization that integrates historical latent states through gated cross-attention, stabilizing long-horizon imagined rollouts and mitigating error accumulation is introduced and an explicit state disentanglement module is designed that separates ego-relevant from ego-irrelevant interactive states, enabling more interpretable and efficient decision-making in complex traffic scenarios.
Abstract
End-to-end autonomous driving has increasingly adopted world model-based reinforcement learning frameworks to improve learning efficiency through \textit{imagined rollouts}. However, existing world models suffer from three key limitations: temporal inconsistency in long-horizon imagined rollouts, inadequate modeling of ego-environment interactions, and limited adaptability to diverse driving styles. To address these challenges, we propose \textit{StyleDrive}, a world-model-based learning framework that jointly enforces long-horizon consistency, explicitly disentangles interactive traffic states, and supports multi-style policy optimization within a unified learning paradigm. First, we introduce a temporal consistency regularization that integrates historical latent states through gated cross-attention, stabilizing long-horizon imagined rollouts and mitigating error accumulation. Second, we design an explicit state disentanglement module that separates ego-relevant from ego-irrelevant interactive states, enabling more interpretable and efficient decision-making in complex traffic scenarios. Third, we enable multi-style driving behaviors through Group Relative Policy Optimization, which replaces per-step reward optimization with trajectory-wise relative advantages, reducing reward variance and supporting diverse driving styles without retraining. We evaluate StyleDrive on the Bench2Drive closed-loop driving benchmark, achieving a driving score of 88.44 (+17.08 over the previous best world model-based method) and a success rate of 66.82 (+16.58). Furthermore, we deploy StyleDrive on a real automated guided vehicle platform and demonstrate promising sim-to-real transfer capability in dynamic driving scenarios.
The Dual-Latent World Model is introduced, which separates local execution and long-range planning through distinct state representations and dynamics models and proposes Long-Horizon Representation Learning with Weighted Rollout (LoRe), which supervises self-generated predictions at both levels.
De-Ling Zhao, Zheng-Rong Yue, Shao-Bin Zhuang et al.· 0 citations
WALL-SS is introduced, a world model that generates visual futures through Scale-wise autoregressive Scaling, enabling action-controllable and long-horizon robotic simulation, and consistently benefits from on-policy alignment in reducing action drift and long-horizon inconsistency.
Maeve Zhang, Rainy Sun, Xiang Wang et al.· 2 citations· ⚡1
World--action models (WAMs) promise a unified model that predicts action-conditioned futures, generates feasible actions, and supports planning in imagination. However, existing joint video--action models often use computationally heavy, fixed-horizon backbones ill-suited to streaming inference and stable long-horizon...
R. Khorrambakht, Joseph Amigo, Félix Lebel et al.· 0 citations
Drive-HWM is presented, a hierarchical slow--fast world modeling framework that organizes future representation prediction and action generation at complementary temporal scales and introduces Dynamic-Aware Latents learned through optical-flow prediction.
Zhao-Xin Fan, Tian-Bao Zhang, Wen-Jun Wu et al.· 0 citations
MM-Future, a world-action model that generates multiple paired scene-action hypotheses and models bidirectional interaction within each pair, shows consistent improvements over both single-mode and action-only variants, validating the benefit of multi-mode joint world-action modeling.
Shuai Liu, Hechangle Gong, Hao Jiang et al.· 1 citation
Autonomous social navigation requires balancing efficiency, physical safety, and social compliance. Reinforcement Learning (RL) methods provide a viable and effective solution but often rely on unrealistic assumptions, such as the knowledge of humans'position and velocity. In this paper, we introduce JESSI (JAX-based E...
T. van der Meer, A. Garulli, Antonio Giannitrapani et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.