Temperature-Scaled On-Policy Self-Distillation (TS-OPSD), a lightweight policy reheating method that internalizes the exploratory effect of temperature into model parameters, suggests that entropy restoration can serve as a simple post-collapse intervention for extending reasoning-oriented RL.
Xue Yang, Jiachen Yu, J. Wu et al.· arXiv.org· 1 citation
It is found that effective warm-up relies on teacher-compatible chain-of-thought supervision, and that even incorrect teacher rollouts can provide comparable benefits to correct ones, which suggests that warm-up primarily transfers a teacher-compatible thinking pattern rather than merely correct answers.
Tao Liu, Taiqiang Wu, Mao Zheng et al.· 3 citations· ⚡1
This work introduces credit-addressable reasoning, in which the semantic units exposed during inference also define where learning compares alternatives and assigns credit, and instantiates Code-CoT, which retains the diagram, represents visual relations as line-addressable executable code, and organizes reasoning into...
Jia-Ni Guo, Junjie Wang, Jie Wu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.