On the Off-Policy Teacher in On-Policy Distillation
Control experiments show that SCOUT improves the teacher's ability to continue from student-generated prefixes, supporting the intended mechanism of student-conditioned teacher adaptation, and consistently improves the effectiveness of on-policy distillation.