Generating personalized dance videos from a reference image, text prompt, and audio track requires music-conditioned body motion. Singing-and-dancing adds a second requirement: the visible subject must also articulate the vocals. Existing music-conditioned methods focus primarily on choreography, while speech-driven mo...
Tao Feng, Xu Li, Xiangyang Luo et al.· 0 citations
SonicWeave is proposed, a flow-matching model for unified audio scene generation that supports speech, music, sound effects, singing, and their fine-grained mixtures with a single set of weights and suggests that temporally coherent, prior-evidence routing is an effective conditional-computation strategy for unified au...
Yun-Rui Cai, Xu Li, Yucheng Zhou et al.· 0 citations
Music videos are an important form of audiovisual expression in contemporary culture. They translate and extend the expressive content of songs through deliberate visual design. Existing automatic music video (MV) generation systems can generate visually plausible shots, yet often struggle with long-form coherence and...
Si-Fei Li, Min-Yan Luo, Xu Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.