Dual-Entropy Enhanced Policy Optimization (DEEPO), a dual-stage enhancement combining signal variance regularization with gradient preconditioning with semantic-entropy-triggered expert prefixes inject grounded continuations on high-uncertainty queries, providing direct supervision and restoring advantage variance.
Ying-Xuan Zhuang, Miao Pan, Wang-Jie Gan et al.· 0 citations
UECR-GRPO is introduced, which integrates verifier and teacher signals within a single GRPO-style update at both the response and token levels and uses the signed teacher--old-policy token gap to redistribute the verifier-derived component.
Jie Zhang, Jing-Xiao Yang, Zhehao Huang et al.· 1 citation
Experiments with GRPO and GiGPO on ALFWorld, WebShop, and SearchQA show that both axes provide independent gains and that their combi- nation consistently achieves the strongest overall performance across model scales.
Ying-Xuan Zhuang, Bin-He Yu, Jing-Xiao Yang et al.· 1 citation
TASPO, which converts privileged supervision into outcome-grounded action credit, is introduced and indicates that TASPO reduces supervision mismatch and that action-level assignment stabilizes the policy optimization process.
Jing-Xiao Yang, Wang-Jie Gan, Ying-Xuan Zhuang et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.