On-policy rollout methods such as GRPO are central to post-training of large language models, yet they frequently suffer from training instabilities, cross-task capability degradation, and response-length inflation. Although prior work has characterized the subspace geometry of aggregate updates, the stepwise variation...
Kai Yang, Jingwei Xu, Wan-Yu Wang et al.· 0 citations
Proxy OPD is introduced, an asynchronous post-training framework that transfers reward-induced policy improvements rather than absolute policy distributions and establishes relative policy updates as highly reusable, adjustable assets for scalable, reward-based post-training.
MUSE is a framework that enables iterative self-improvement through a hierarchical Memory Module that organizes cross-domain insights to facilitate the orchestration of long-horizon workflows and demonstrates that MUSE’s performance scales with the accumulation of insights and exhibits strong cross-task transferability...
Cheng Yang, Xuemeng Yang, Licheng Wen et al.· Annual Meeting of the Associ...· 2 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
