Preprint
Aug 2026
Beyond Outcome Rewards: Step-Level Self-Distilled Policy Optimization for Deep Search Agents
Evidence Anchors are constructed, which are concise, step-level evidence snippets extracted from the web, as privileged information that captures key reasoning steps without revealing the entire answer path, and SSPO, which converts teacher-student disagreement into step-level advantage weights within GRPO, applied exclusively to incorrect trajectories.
Haoze Wu, Chuqiao Kuang, Tianyi Zhuang et al.
· 0 citations