Information Gain-based Rollout Policy Optimization: An Adaptive Tree-Structured Rollout Approach for Multi-Turn LLM Agents
Information Gain-based Rollout Policy Optimization (IGRPO) is proposed, a policy optimization framework that treats intermediate-state informativeness as the organizing principle of rollout collection and performs budget-aware tree-structured rollouts by allocating expansion budget according to node-level informativeness.