Reinforcement learning with verifiable rewards has become a scalable post-training paradigm for large language models. However, training agents over long-horizon interactions presents two challenges: using only terminal rewards makes turn-level credit assignment sparse and high-variance, while sequential mini-batch upd...
Heming Zou, Qi Wang, Yi-Xiu Mao et al.· 1 citation
This paper revisits the standard state-only formulation of value estimation and proposes PPO, a self-privileged actor-critic framework that consistently improves value-estimation quality by a substantial margin and outperforms representative actor-critic and critic-free RLVR baselines on challenging mathematical reason...
Kun Liang, Chenming Tang, Clive Bai et al.· 0 citations
Downstream RLHF experiments additionally show that using DRM as the training-time reward leads to improved policy performance, directly validating the practical benefit of diffusion-based reward modeling for RLHF training.
Xiang-Yang Wang, Bing-Xiang He, Ze-Yuan Liu et al.· 0 citations
StudyBench is introduced, a controlled physics benchmark that directly measures how efficiently a self-evolution method converts training material into capability, and turns self-evolution progress from an open-ended pursuit into a measurable target for future research.
Ying-Hao Chen, Zi-Xi Chen, Bingxiang He et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.