Vorch-Human is presented, a unified human-centric generation framework built on a dual-stream audio-video diffusion transformer that augments the conventional noisy audio/noisy video interface with clean condition-audio and condition-video token groups and adapts to long-form audio-driven generation by training with cl...
Vorch-Omni is presented, a unified multi-task framework for audio-visual synthesis based on an arbitrary-condition-to-arbitrary-output formulation that supports over 10 tasks, including text-to-video, text-to-audio-video, image- and reference-conditioned generation, temporal extension, audio-driven generation, video tr...
Vorch Team, Xiaoyu Chen, Yang Ding et al.· 0 citations
Vorch-Streamer, a post-training framework that addresses real-time long-form Text-to-Audio-Video (T2AV) streaming and enables real-time long-form avatar audio-video streaming, and bounded causal context and four-step denoising are presented.
Meng-Lin Han, Yang Ding, Yu-Lei Lu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.