#artificial intelligence
Sep 2026
On the Off-Policy Teacher in On-Policy Distillation
Control experiments show that SCOUT improves the teacher's ability to continue from student-generated prefixes, supporting the intended mechanism of student-conditioned teacher adaptation, and consistently improves the effectiveness of on-policy distillation.
Lang-Lin Huang, Hao Liu, Mononito Goswami et al.
· arXiv.org · 1 citation