WorldSonus, an interactive video-to-audio framework designed for real-time spatial sound synthesis in world models, generalizes effectively to open-domain video-to-audio benchmarks, matching or outperforming state-of-the-art bidirectional models in both acoustic quality and spatial alignment.
Peng Fang, Jing-Yi Fa, Kam-Man Wu et al.· 0 citations
World simulation is inherently multisensory, demanding synchronized visual and acoustic dynamics in real time. Yet prevailing interactive world models remain strictly silent, focusing exclusively on visual rendering and control while overlooking the acoustic dimension. We present HelixWorld, a real-time interactive aud...
Lei Ke, Jia-Hao Pan, Ze-Yue Tian et al.· 0 citations
LiveLight is presented, the first diffusion-based framework for real-time streaming video relighting with interactive 3D lighting control, which achieves state-of-the-art relighting quality while running at real-time speed, and will publicly release its models, training data, and synthetic data generator.
Yue Ma, Jiangming Wang, Yucheng Wang et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.