Preprint
Aug 2026
WDL-OPD: Weak-Driven On-Policy Distillation via Mixture-Constrained Co-Training
WDL-OPD is introduced, a mixture-constrained co-training method with two trainable policies that shows that freezing the auxiliary recovers an anchor-plus-contrast proxy target closely related to OPD$^2$ and W2S-OPD, whereas joint training creates branch-level degrees of freedom that a static delta cannot express.
Zehao Chen, Gong-Xun Li, Tianxiang Ai et al.
· 0 citations