Critic-Targeted Exploration: Learned Per-Rollout Targeting of Entropy Bonuses in GRPO
A four-rung ablation ladder of increasing targeting precision applied to the entropy bonus, holding the entropy setpoint fixed and varying only where the bonus is placed answers the question: does learned, per-rollout targeting of exploration beat heuristic targeting beat no targeting?
Hlumelo Notshe
· 0 citations