Beyond Imitation: Reflective On-Policy Self-Distillation for LLM Reasoning
Experiments show that Reflective On-policy Self-Distillation (ROSD), which distills transferable reasoning insights rather than complete reference trajectories, consistently outperforms standard OPSD and reinforcement learning baselines, better preserves reasoning diversity, stabilizes training, and mitigates late-stag...
Zi-Qi Zhao, Xin-Yu Ma, Liu Yang et al.
· 16 citations