What Matters in On-Policy Distillation? A Perspective on Data Efficiency and Data Selection
This paper presents an empirical study of data efficiency and data selection in OPD, and proposes a simple data selection method that selects only hard examples for training, where even"unsolvable"examples that completely exceed the teacher's capability can be successfully used.