Current datasets for text-to-video generation are largely limited to short clips depicting a single event or coarse-grained captions. As a result, they provide limited supervision for modeling long-take temporal dependencies, often leading to temporally inconsistent generations when describing multiple events. In this...
Pei-Yuan Zhu, Shao-An Xie, Yi-Fan Shen et al.· 0 citations
Autoregressive video generators synthesize long videos through chunk-wise rollouts, yet they are typically trained to predict only the immediate future. This limited prediction horizon makes it challenging to maintain video quality over extended rollouts. To address this problem, we introduce Prospective Forcing, a mul...
Yi-Fan Shen, Ye-Wei Xia, Gong-Xu Luo et al.· 0 citations
This work identifies a surprising yet consistent phenomenon that it is identified: despite using high-dimensional embeddings, VQVAEs tend to compress their representations into a much smaller subspace, typically only 4 to 10 dimensions, and proposes Divide-and-Conquer VQ, which partitions the latent space into multiple...
Jiayou Zhang, Yifan Shen, Guan-Hong Chen et al.· Neural Information Processin...· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.