Information-Time Proximal Policy Optimization
RLVR has substantially improved the reasoning capabilities of LLMs. However, existing methods typically parameterize temporal progression in the Markov Decision Process by token-by-token generation, despite the highly non-uniform information flow along autoregressive trajectories. In this paper, we propose InfoPPO, whi...
Yong-Cheng Zeng, Xin-Yu Cui, Yan Song et al.
· 0 citations