Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
On-Policy Reverse Distillation (OPRD), which evaluates the teacher's policy shift relative to its reference policy on student rollouts and amplifies the component of the student's verifier-driven policy gradient along that direction, and effectively combines verifier-driven policy optimization with teacher guidance reg...
Youngrok Park, Sangmin Bae, Hojung Jung et al.
· 3 citations