Proposing Better Rollouts for On-Policy Distillation
On-policy distillation (OPD) improves language-model post-training by letting the student learn from its own sampled trajectories under teacher supervision, aligning the training process with inference-time behavior. However, the rollout policy in OPD is usually treated as fixed: each round samples directly from the cu...
Si-Rui Chen, Yun-Zhe Qi, Hao-Bo Xu et al.
· 0 citations