Flash-OPD: Fast On-Policy Distillation
On-policy distillation (OPD) provides dense teacher supervision on student-generated trajectories, but generating and evaluating long rollouts incurs substantial training cost. Existing acceleration methods reduce this cost through open-loop rollout schedules or closed-loop horizon adaptation. However, supervision comp...
Wei Chen, Junle Chen, Yi-Tong Yang et al.
· 0 citations