GFD-OPD: Guidance-Folded On-Policy Distillation of Diffusion Models Across Scales
On-policy distillation (OPD) has demonstrated two important capabilities in language models: compressing large teachers into smaller students and merging expert models into a single model. Existing diffusion OPD, however, mostly focus on the latter, with teachers and students sharing the same backbone and scale. We inv...
Zhen-Xing Zhang, Jia-Yan Teng, Wen-Xu Wu et al.
· 0 citations