Speculative Sampling in Interactive Video Generation
Speculative Sampling is proposed, a strategy that combines the modeling power of large bidirectional windows with the low-latency interaction of small ones, opening a path to serving large bidirectional models in interactive streaming systems without complex streaming post-training.
Yu-Bo Huang, Yuxuan Zhang, Jia-Ming Liu et al.
· 0 citations