OSVE is presented, the first framework to successfully adapt one-step Text-to-Image (T2I) models for high-quality video editing, addressing the core challenges of inversion, editability, and temporal consistency.
Abstract
Text-guided video editing with diffusion models is impractically slow, hindered by costly multi-step sampling and inversion. We present OSVE, the first framework to successfully adapt one-step Text-to-Image (T2I) models for high-quality video editing, addressing the core challenges of inversion, editability, and temporal consistency. To bypass slow iterative inversion, we train a learnable encoder that predicts the initial noise for each frame in a single forward pass. This encoder is trained with a novel Structure-Aware Editing (SAE) loss on a curated dataset of structurally-aligned image pairs, teaching it to preserve the source video's geometry during edits. For temporal coherence, we introduce Unified-Frame Editing (UFE), a technique that concatenates frame latents to facilitate cross-frame attention in a single generation step. Furthermore, for long videos, a sliding-window strategy with an anchor frame maintains global consistency. Our extensive experiments demonstrate that OSVE achieves editing quality comparable or superior to state-of-the-art multi-step methods, while operating approximately 155--171 times faster. This breakthrough paves the way for practical, real-time video editing applications. Code is available at https://github.com/KU-VGI/OSVE.
A warping-error bound is derived that separates motion bias from stochastic flicker and predicts diminishing returns with larger temporal windows, and ChordVideo achieves competitive temporal consistency and source preservation using 10--60 model steps per clip.
Conventional video editing primarily focuses on scene-level content, whereas live streaming places greater emphasis on the human subject. However, directly applying existing video-editing methods to human-centric live streaming remains challenging, as they may introduce facial-expression inconsistencies and typically d...
Zhiyuan Li, Chi-Man Pun, Peng-Tao Jiang et al.· 0 citations
Backbone training-free video editing built on pre-trained text-to-image (T2I) diffusion models enables lightweight, prompt-driven edits without additional finetuning. A critical yet often overlooked factor is cross-frame latent selection during DDIM inversion, which largely determines spatiotemporal coherence in the su...
Zhangkai Wu, Xuhui Fan, Zhongyuan Xie et al.· Proceedings of the 32nd ACM...· 0 citations
This work revisits one-step image editing from a spatially controlled perspective and proposes WhereEdit, a framework that reformulates one-step editing as localized adaptive editing that consistently outperforms existing one-step image editing methods, achieving superior editing quality while maintaining the efficienc...
Ming Hu, Ming-Yu Dou, Jian-Fu Yin et al.· arXiv.org· 1 citation
A high-quality video editing framework enhanced for consistency and editability, named EquiEdit, is proposed, which improves coordinatively the temporal consistency and editability of the edited videos while achieving a balance between the two.
MSEditor is proposed, the first framework designed specifically for consistent multi-shot video editing, which significantly outperforms existing methods on the authors' curated multi-shot video editing benchmark in terms of identity preservation, temporal stability, and overall visual quality.
Kun-Yu Feng, Yue Ma, Bing-Yuan Wang et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.