#artificial intelligence
Sep 2026
Unlocking the Critic: Reward-Free Policy Optimization for LLM Post-Training
Reward-Free Policy Optimization (RFPO), which repurposes a single calibrated, frozen critic as a rollout-level reward, a value baseline for generalized advantage estimation, and a success forecaster for unfinished prefixes is introduced.
Hong-Yang Li, Xiao Li, Caesar Wu et al.
· arXiv.org · 0 citations