Not Every Rollout Needs Distillation: Correctness-Filtered On-Policy Self-Distillation
Correctness-filtered OPSD (C-OPSD), which generates one response per problem and distills only a subset of incorrect responses, is introduced, which connects outcome-conditioned supervision redundancy to more compute-efficient distillation.
Harrison Zhao, Lei Huang, Zhi-Yuan Zhao et al.
· 0 citations