Privy to the Foil: Recasting Value Estimation with a Self-Privileged Critic for RLVR
This paper revisits the standard state-only formulation of value estimation and proposes PPO, a self-privileged actor-critic framework that consistently improves value-estimation quality by a substantial margin and outperforms representative actor-critic and critic-free RLVR baselines on challenging mathematical reason...