The Large Processing Model is presented, a diffusion-based generative framework for photorealistic video restoration under complex, in-the-wild degradations, demonstrating that generative restoration can be practical, scalable, and cost-effective for large-scale video processing.
Abstract
We present the Large Processing Model (LPM), a diffusion-based generative framework for photorealistic video restoration under complex, in-the-wild degradations. To our knowledge, LPM is the first generative video restoration model deployed at industrial scale. LPM addresses the diverse degradations in user-generated content (UGC) through a unified system encompassing large-scale data engineering, foundation-model training, and efficient inference. Its enhanced architecture, progressive training strategy, and temporal-pyramid inference mechanism jointly enable high-fidelity, temporally consistent restoration of arbitrarily long videos across the broad content distribution encountered on UGC platforms. LPM has been deployed in production at Kuaishou, where videos processed by the model account for approximately 45% of total viewing time, delivering consistent improvements across key quality-of-experience metrics. Beyond perceptual enhancement, LPM delivers substantial system-level benefits: at comparable perceptual quality, it reduces bitrate by 20% relative to Kuaishou's in-house codec, yielding annual bandwidth cost savings on the order of hundreds of millions. Its low serving cost also enables integration into products such as Kling, demonstrating that generative restoration can be practical, scalable, and cost-effective for large-scale video processing.
V-LITE (Video generation models are inherent lighting estimators), a framework that unlocks internal knowledge by reframing lighting estimation as a guided video inpainting task, is introduced, revealing that modern video diffusion models are not merely synthesizers but also powerful, inherently capable estimators of p...
Ziqi Cai, Shuchen Weng, Kaiqi Liu et al.· arXiv.org· 0 citations
This work proposes FaverNet, a Frequency-guided All-in-one VidEo Restoration Network, which incorporates a Frequency-discriminative Conditioning Mechanism (FCM) and a Prompt-guided Alignment Mechanism (PAM), which enhances the degradation-awareness of the restoration process by conditioning the model with degradation c...
Haiyu Zhao, Yuanbiao Gou, Boyun Li et al.· International Journal of Com...· 0 citations
This work introduces SANA-Video 2.0, a hybrid video diffusion transformer instantiated at 5B and 14B scales under a unified architecture that recovers softmax-level expressiveness at substantially reduced cost, unlocking scalable long, high resolution video generation.
Junsong Chen, Jincheng Yu, Yitong Li et al.· arXiv.org· 1 citation· ⚡1
OminiVR surpasses all prior methods on all six visual metrics, achieves the best audio quality, and produces natural colorization---the first method to jointly address all three aspects of audio-video generative restoration.
Xin Lu, Zihao Fan, Mingchen Zhong et al.· 1 citation
High-Compression videos suffer from severe distortions, among which degradation in person regions has the greatest impact on viewers’ immersive experience. Existing quality enhancement techniques usually focus on overall image denoising or super-resolution, often overlooking the crucial recovery of fine structures in t...
Lin-Yun Liu, Li Yu, Jia-Xin Zeng et al.· IEEE Signal Processing Lette...· 0 citations
This paper proposes BinRVR, a binarized RAW video restoration framework that reduces computation and parameters by approximately 96% while incurring only about 4% performance degradation, and develops a Distribution-Aware Binarized Convolution (DAB-Conv) that leverages the statistics of full-precision activations to mi...
Tianyu Zhu, Ying Fu, He-Song Li et al.· IEEE Transactions on Pattern...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.