Grounded Credit Assignment in Reinforcement Learning for Multi-Turn Search Agents
Outcome-reward reinforcement learning such as GRPO gives every token of a search-agent rollout the same advantage, although the rollout exercises two capabilities: finding evidence and using it. We show that accuracy improves without grounding: Search-R1 raises accuracy on all seven QA benchmarks, yet on Bamboogle the...
Qi-Rui Liu, Hao Chen, Yi Wen et al.
· 1 citation