Learning to Reason with Selective Internal Feedback
Reinforcement learning from internal feedback can improve language models without ground-truth answers or external verifiers. However, confidence and correctness can diverge during training, and continued optimization of average self-certainty can increase confidence while degrading reasoning accuracy. We introduce SIF...
Xu-Zheng-Long-Wang Lu, Shu-Meng Yang, Xin-Rui Wang et al.
· 0 citations