Diffusion models achieve impressive image-generation quality but remain expensive at inference time. Diffusion distillation reduces sampling steps, yet many distilled models, including SDXL-Lightning and distribution matching distillation methods, suffer from degraded Fr\'echet Inception Distance (FID). We analyze this phenomenon through a PAC-style generalization bound. Our analysis suggests that aggressive early-step redirection of the velocity field makes the distillation target harder to learn, enlarging the train-test gap. As a result, early-step output distributions differ between training and inference, causing distribution mismatch in the intermediate noisy latent used as next-step inputs. We empirically validate this mechanism by showing reduced diversity in both intermediate features and final outputs. To address this issue, we propose EMPURPLE, a simple training-free method that recycles intermediate latents sampled from the original model. EMPURPLE is model-agnostic and improves FID by 7\% to 20\% across DMD2, Hyper-SD, FlashSD, and SDXL-Lightning. The repo is: https://github.com/TheLovesOfLadyPurple/Empurple-Training-Free-Algorithm-To-enhance-Diversity-of-The-Diffusion-Distillation-Model
The Interval Denoiser, a theoretically rigorous framework for latent-free generation, derived directly from the flow matching ODE, establishes an exact analytical mapping for intermediate trajectory states and is shown to reside on a low-dimensional manifold across any time interval.
A. Zaytsev, Dmitry Baranchuk, Alexander Korotin et al.· 0 citations
This article introduces variance-reduced consistency learning (vrCL), a novel distillation technique that enables stable and efficient training of consistency models without relying on teacher model evaluations, resulting in high computational efficiency and significantly reduced training time.
Seer is proposed, a training-free framework that detects their valid semantic boundary using a Signal-to-Noise Ratio (SNR)-based criterion and performs one-shot truncation of the redundant suffix for all subsequent computations, offering a highly efficient, plug-and-play solution for DMLLM acceleration.
A novel post-training acceleration framework that exploits this redundancy by integrating dynamic structural sparsification directly into the distillation process, and introduces a Progressive Training Strategy coupled with an Output Rollout Mechanism that ensures the coherent learning of structural decisions across ti...
Yu Cheng, Siyue Yao, Zhongang Qi et al.· 0 citations
This paper forms few-step generation as a controlled base generative process, and shows that self-consistency loss can be understood through the lens of optimal control, and draws a connection between this approach and reinforcement learning, potentially opening the door to a new set of approaches for few-step generati...
Paribesh Regmi, S. Ghimire, Rui Li· International Conference on...· 0 citations
This study studies a family of training-free techniques conceptually rooted in Classifier-Free Guidance, most of which were originally proposed on older U-Net diffusion models and validated using metrics that assess image quality in isolation, without accounting for compositional alignment or semantic correspondence.
A. Sergievskii, Artyom Turevich, Sergey Kastryulin· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
