Who Teaches Which Token? Verifier-Gated Multi-Expert On-Policy Distillation for Scientific Reasoning
Verifier-Gated Multi-Expert On-Policy Distillation (VG-OPD) attains the best overall performance on seven benchmarks for 4B and 8B students, ranking first on five at both scales, with the largest gains on knowledge-intensive scientific reasoning tasks.
Xun Xu, Zai-Xi Zhang
· 3 citations
· ⚡1