This work introduces TD-V2A, which leverages temporal differences (TD) as the key representation that distinguishes V2A from I2A, enriching visual conditioning with minimal architectural modification and significantly improves end-to-end V2A generation quality, even outperforming dedicated V2A representations such as c...
Zehua Chen, Junyou Wang, Yuxuan Jiang et al.· 0 citations
This work introduces VideoChat3, a fully open, efficient, and generalist video-centric MLLM, which surpasses prior open-source models with equal or larger parameter counts with only 4B parameters and higher efficiency.
AURORA-LM is introduced, a continuous-latent diffusion language model that separates the construction of a decodable text representation from the modeling of its distribution, and achieves the strongest performance among evaluated continuous and diffusion-based language models on OpenWebText free generation and XSum su...
Jiajun Liang, Yu-Ling Liao, Yu-Kang Cao et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.