ForeDrive is proposed, which learns a planning-relevant latent representation and couples it asymmetrically to a Diffusion Transformer (DiT) planner and attains 89.9 PDMS on NAVSIM v1 and 90.0 one-stage EPDMS on NAVSIM v2, without reinforcement learning or an external trajectory scorer.
Abstract
Existing latent world models are typically optimized for future predictability, yet the resulting representations are not necessarily useful for planning in autonomous driving. Predictions are commonly used for pretraining or auxiliary supervision rather than as direct conditioning signals for trajectory generation. We propose ForeDrive, which learns a planning-relevant latent representation and couples it asymmetrically to a Diffusion Transformer (DiT) planner. The planner consumes multi-horizon latent future representations learned with a JEPA-style world model; planning gradients update the shared online encoder, while stop-gradient routing trains the latent predictor with forecasting losses only. Because predicted futures have varying reliability across horizons and BEV trajectories are misaligned with image tokens, we use gated visual fusion, future-status injection, and Trajectory-Adaptive Bias (TAB) to inject future latents as guidance without overriding the current observation. Trained with pure imitation learning and using only the current front-view image as visual input at inference, ForeDrive attains 89.9 PDMS on NAVSIM v1 and 90.0 one-stage EPDMS on NAVSIM v2, without reinforcement learning or an external trajectory scorer.
ForeWAM is proposed, a dynamics-conditioned direct-policy WAM that provides predictive context for action generation without decoding future videos, and demonstrates that direct-policy WAMs can retain efficient action prediction while exposing predictive dynamics to the action pathway without explicitly generating futu...
Jiakai Huang, Zhongbo Wu, Siyu Xu et al.· 3 citations
DA-WAM is proposed, a framework that unifies predictive representation learning, action-conditioned future modeling, and trajectory scoring under a single decision-making objective and demonstrates state-of-the-art performance on NAVSIM-v1 and NAVSIM-v2.
Rui-Guo Zhong, Ben-Shan Ma, Xiao-Long Chen et al.· 5 citations
Driving policies require capabilities of scene understanding and future evolution prediction. To achieve this goal, current end-to-end models typically construct complex perception-planning pipelines or introduce world models that explicitly predict future states, resulting in a complex system architecture. Inspired by...
Yue-Ting Zhu, Shao-Yu Chen, Yue-Hao Song et al.· arXiv.org· 0 citations
The proposed World-Model Alignment for Latent Trajectories (WALT), which learns a compact generative trajectory latent space by transferring information from a frozen pretrained driving world model without modifying the world model itself, is proposed.
Ming-Kai Jia, Jia-Xin Guo, Zhi-Jian Shu et al.· 0 citations
Recent Vision-Language-Action (VLA) models for autonomous driving have incorporated world modeling by predicting future driving scenes alongside driving actions, demonstrating strong planning performance. Future driving scenes are utilized as dense supervision, encouraging the policy to learn rich internal representati...
Dogun Kim, Y. Lee, Joonhee Lim et al.· arXiv.org· 0 citations
Metro-WM is introduced, a hierarchical framework that issues sub-goals by retrieving genuine states from prior experience rather than generating ungrounded latent vectors that achieves superior long-horizon success rates and maintains robust performance under extremely sparse dataset conditions.
Royson Lee, Fady Rezk, Titouan Parcollet et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.