World simulation is inherently multisensory, demanding synchronized visual and acoustic dynamics in real time. Yet prevailing interactive world models remain strictly silent, focusing exclusively on visual rendering and control while overlooking the acoustic dimension. We present HelixWorld, a real-time interactive aud...
Lei Ke, Jia-Hao Pan, Ze-Yue Tian et al.· 0 citations
Advances in generative models have improved video fidelity, enabling long-horizon generation, interactive world modeling, and evolving visual environments. Autoregressive (AR) video generation extends visual sequences through causal rollouts. However, a fundamental bottleneck emerges: as the generated sequence expands,...
Harold Haodong Chen, Rong-Jin Guo, Di-Sen Lan et al.· 0 citations
USR-Drive is proposed, a unified conditional generative framework that, given only posed multi-view driving videos, jointly recovers dense dynamic geometry and instance-level object layouts within a shared scene representation and delivers state-of-the-art results for both dynamic reconstruction and 3D detection on the...
Li-Heng Chen, Haokai Pang, Cheng Su et al.· 0 citations
This work proposes IQA-T1, a tool-based visual evidence reasoning framework that augments MLLM reasoning with explicit perceptual observations and constructs Q-Tool, a dataset containing 11k multimodal reasoning chains grounded in tool-generated evidence.
Remember-R1 is proposed, a reinforcement learning framework that mitigates long-context visual forgetting by applying process-level supervision directly on the original reasoning trajectory, demonstrating its effectiveness in mitigating long-context visual forgetting.
Jianmin Chen, Jiaqi Tang, Wei Wei et al.· 0 citations
Unified image and video creation requires a model to follow diverse instructions while preserving identity, geometry, and temporal structure from visual context. However, semantic-only conditioning and creation-only training do not explicitly supervise the local structure needed for precise, temporally consistent editi...
Zhe-Fan Rao, Bin-Yi Zou, Xuanhua He et al.· 0 citations
MSEditor is proposed, the first framework designed specifically for consistent multi-shot video editing, which significantly outperforms existing methods on the authors' curated multi-shot video editing benchmark in terms of identity preservation, temporal stability, and overall visual quality.
Kun-Yu Feng, Yue Ma, Bing-Yuan Wang et al.· 1 citation
This work organizes the embodied data ecosystem as a pyramidspanning five complementary sources: real-robot data, UMI-style data, egocentric and exocentric data, simulation data, and general vision-language data, and further characterize each source in terms of data quality, diversity, reusability, and physical fidelit...
Yifan Ye, Yankai Fu, Ya-hui Lv et al.· arXiv.org· 4 citations
LeapBot-WA establishes a novel Predictive-Latent paradigm for WAMs by operationalizing the Joint-Embedding Predictive Architecture (JEPA) as a World-Anchor and introduces the Isotropic Semantic Autoencoder (ISAE), which reshapes the anchor's latent space into a diffusion-friendly manifold to prevent off-manifold drift.
Pei Liu, Nan Zheng, Lang Zhang et al.· arXiv.org· 0 citations
This work investigates LLM-based forecasting agents, meaning systems in which a language model contributes to a scored prediction about a future or currently unobserved target, and organizes architectures into three groups.
Xiao-Gang Xu, Jiaqi Tang, Jianmin Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
