Preprint
Aug 2026
Simple-OPD: Demystifying Warm-up for On-policy Distillation
It is found that effective warm-up relies on teacher-compatible chain-of-thought supervision, and that even incorrect teacher rollouts can provide comparable benefits to correct ones, which suggests that warm-up primarily transfers a teacher-compatible thinking pattern rather than merely correct answers.
Tao Liu, Taiqiang Wu, Mao Zheng et al.
· 3 citations
· ⚡1