On-policy self-distillation (OPSD) trains mathematical reasoning models using a privileged teacher that sees a reference solution and supervises student-sampled prefixes. Standard OPSD uses one fixed parameter setting at every state, but nearby settings may offer additional supervision. We find that local parameter per...
Xin Wei, Yi-Fan Ding, Yoshua Y. Li et al.· 0 citations
DagEvo is introduced, whose diagnostician extracts recurring error causes from this history and stores them in a hierarchical error-cause memory, whose diagnostician extracts recurring error causes from this history and stores them in a hierarchical error-cause memory.
Xin Wei, Yinze Ding, Yoshua Y. Li et al.· 0 citations
To mitigate a critical imbalance during the exploration-and-learning process, this work approaches head-tail re-balance during the exploration-and-learning process from two perspectives: distribution-reshaping and trajectory-resampling.
Xin Guo, Zhiheng Xi, Yiwen Ding et al.· Annual Meeting of the Associ...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.