Jin-Hao Pan

Learning from Self-Generated Responses: Reliability--Uncertainty Self-Distillation for Reasoning

Reliability--Uncertainty Self-Distillation weights each attempt's distillation loss by additively combining judged reliability, estimated from a self-judge's score and confidence, with student predictive uncertainty.