Audio-driven lip synchronization manipulates the mouth region of a talking-face video to match the driving audio while preserving head pose, identity, and background. Although the task is inherently local editing, prevailing approaches reconstruct the entire lower face with heavy GAN- or diffusion-based decoders, incur...
Fa-Ting Hong, Runzheng Liu, Luchuan Song et al.· 1 citation
Experiments on BEAT2 show that GestureFAR significantly improves the quality--latency trade-off among streaming-capable methods, preserving strong gesture quality while enabling real-time token-causal generation.
Pin-Xin Liu, Hai-Yang Liu, Jia-Hao Luo et al.· 1 citation· ⚡1
A benchmark that tests the ability of agentic video understanding by asking agents to reconstruct real-world videos as animated Blender scenes, and shows that programmatic reconstruction is a viable test of agentic video understanding, and that semantic retention remains the main challenge.
Y. Y. Tang, D. Shimada, Jia-Yue Meng et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.