RoVR-GSPO is introduced, a dual-channel robust optimizer that addresses group-relative policy optimization failure modes separately and shows consistent improvements over GSPO, while controlled perturbation studies demonstrate stronger robustness to reward contamination and token-ratio anomalies.
Zhong-Yi Li, Wan Tian, Xiang Xu et al.· 0 citations
Reward hacking occurs when policy optimization exploits a brittle reward interface or an overly permissive proxy objective, improving the training score without improving the underlying response quality. This phenomenon is amplified in group-relative policy optimization: an unsupported reward can shift the group baseli...
Wan Tian, Zhong-Yi Li, Xiang Xu et al.· 0 citations
Artificial intelligence (AI) is a double-edged sword: while it has achieved remarkable success across a wide range of domains, its deployment also calls for effective oversight and regulation, for which the detection of AI-related content and artifacts is perhaps the most direct and cost-effective approach. To this end...
Xifeng Zhang, Tao Hu, Yijie Peng et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.