Does self-distillation improve reasoning?
Self-distillation is an emerging approach that trains a model to imitate its own predictions when conditioned on privileged information, such as correct answers or environmental feedback. Recent methods have reported better sample efficiency and generalization than reinforcement learning (RL), but it remains unclear wh...
J. Adhinarta, Raina Wu, Ashutosh Sharma et al.
· 0 citations