Language-guided panoramic video generation benefits various downstream applications, such as interactive 3D scene exploration, virtual reality experiences, and embodied agent training. Existing panoramic generators follow predefined trajectories, and interactive world models act through low-level actions in perspective...
Yun-Heng Liu, Zi-Qi Cai, Si-Qi Yang et al.· 0 citations
Recent advancements in generative models are pushing video generation toward unbounded streaming audio-video generation for real-time interactive worlds. However, existing benchmarks primarily evaluate completed sequences and struggle to capture streaming properties. To bridge this gap, we introduce StreamAV-Bench, the...
Kaiqi Liu, Hao-Xuan Zeng, Jingqi Liu et al.· 5 citations· ⚡2
V-LITE (Video generation models are inherent lighting estimators), a framework that unlocks internal knowledge by reframing lighting estimation as a guided video inpainting task, is introduced, revealing that modern video diffusion models are not merely synthesizers but also powerful, inherently capable estimators of p...
Ziqi Cai, Shuchen Weng, Kaiqi Liu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
