Simple-OPD: Demystifying Warm-up for On-policy Distillation
It is found that effective warm-up relies on teacher-compatible chain-of-thought supervision, and that even incorrect teacher rollouts can provide comparable benefits to correct ones, which suggests that warm-up primarily transfers a teacher-compatible thinking pattern rather than merely correct answers.