BooM-VVT is proposed, a mask-free VVT framework built upon the keyframe-driven video generation paradigm, and Garment-Sensitive Keyframe Sampling, which selects keyframes based on garment-relevant body regions to better capture garment appearance, is introduced.
Abstract
Video virtual try-on (VVT) aims to generate realistic videos of a person wearing a target garment. Recent methods leverage a keyframe-driven video generation paradigm to improve in-the-wild performance, yet they still rely on masks to localize try-on regions, making them vulnerable to large motions and severe occlusions. Although mask-free image-based try-on methods have shown promising results by leveraging large-scale pseudo data, extending this paradigm to videos remains difficult, as constructing video-level pseudo data is prohibitively expensive. Furthermore, coarse keyframe sampling and the scarcity of multi-view try-on data limit existing keyframe-driven methods in maintaining garment consistency and handling diverse try-on tasks. To address these challenges, we propose BooM-VVT, a mask-free VVT framework built upon the keyframe-driven paradigm. To achieve mask-free VVT, we introduce a multi-stage training strategy that leverages image-level pseudo data for mask-free localization learning, substantially reducing the need for costly video-level pseudo data. To improve garment consistency, we propose Garment-Sensitive Keyframe Sampling, which selects keyframes based on garment-relevant body regions to better capture garment appearance. We further introduce Frame-Shared 3D-RoPE to establish spatiotemporal correspondences between keyframes and target video frames for accurate garment-detail transfer. Finally, we construct OmniView, a large-scale multi-view try-on dataset to support reliable try-on video generation under complex camera viewpoints and diverse try-on tasks. Extensive experiments demonstrate that BooM-VVT achieves superior temporal consistency and garment fidelity over existing methods. Project page: https://boomvvt.github.io/boomvvt.
This work proposes FlowVVTON, a mask-free framework that eliminates parsing mask dependency entirely, and shows that FlowVVTON outperforms baselines by substantial margins, particularly in temporal consistency.
Sheng Chen, Xianbing Sun, Liqing Zhang et al.· 0 citations
Video virtual try-on has attracted increasing attention due to its broad potential in digital fashion and intelligent e-commerce. However, existing methods primarily focus on low-resolution settings and still face substantial challenges when extended to high-resolution scenarios. These limitations can be attributed to...
Zi-Jing Qin, Jun Zhou, Rui-Cheng Zhang et al.· 0 citations
PMRF-VTON is proposed, a diffusion-based virtual try-on method that integrates pose–mask region modulation with frequency-domain residual guidance and achieves competitive results in terms of SSIM, LPIPS, and FID.
Chuan-Fei Yu, Jin-Guang Chen· International Conference on...· 0 citations
DSE-VTG is proposed, a \underline{D}ual-\underline{S}ide \underline{E}nhancement framework that addresses both temporal dynamics and task-specific training without any task-specific training, and achieves state-of-the-art performance among training-free methods.
Zhuo Cao, Bing-Qing Zhang, Sen Wang et al.· 0 citations
Modern action recognition models rely on video transformers pretrained on massive collections of web-crawled videos, such as Kinetics-700. However, the use of such data raises ethical concerns, as subjects'consent is typically not obtained. Recent high-quality synthetic video datasets generated from motion-capture data...
Ricardo Pizarro, Roberto Valle, J. M. Buenaposada et al.· 0 citations
A Motion-Aware Frame Sampling (MAFS) strategy for constructing motion-aware captions enables more effective utilization of video frames and improves captioning quality for large-motion videos.
Ke-Pan Nan, Tie-Han Fan, Rui Xie et al.· International Journal of Com...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.