On-policy distillation (OPD) supervises a student on its own trajectories with token-level signals from a frozen teacher, yet how a sampled loss allocates updates across tokens remains poorly understood. We analyze the gradient of the per-token K2 estimator of reverse KL with respect to the student logits. The $\ell_1$...
Bing Shao, Jia-Zheng Zhang, Long Ma et al.· 5 citations
ReDraft (Reference-Driven Revision and Fine-Tuning) shows that revising the model's own rollout rather than directly imitating an expert trajectory can reconcile cold-start acquisition with prior-capability retention.
Zhi-Hao Zhang, Ming-Qi Wu, Qiaole Dong et al.· 0 citations
A critique-in-the-loop self-improvement method that incorporates critique-based supervision into the actor’s self-training process and improves the actor’s exploration efficiency and solution diversity, especially on challenging queries, leading to a stronger actor model.
Zhi-Heng Xi, Dingwen Yang, Jixuan Huang et al.· Proceedings of the Thirty-Fi...· 0 citations
Production recommender systems shape what billions of people see, and sustaining their performance requires continual optimization: as content, user behavior, and upstream models shift, the choices governing retrieval, ranking, and serving must be revisited. Traditionally, human engineers test such changes through onli...
Muhammad Azhar, Yu-Hang Zhou, Gilbert Jiang et al.· 1 citation
To mitigate a critical imbalance during the exploration-and-learning process, this work approaches head-tail re-balance during the exploration-and-learning process from two perspectives: distribution-reshaping and trajectory-resampling.
Xin Guo, Zhiheng Xi, Yiwen Ding et al.· Annual Meeting of the Associ...· 1 citation
AgentGym2 is presented, a new evaluation framework with task instances grounded in real-world end-to-end working demands that measures agents'ability to execute end-to-end procedures, discover tools via exploration, compose tools for unseen tasks, and remain robust to noisy and underspecified information.
Zhiheng Xi, Dingwen Yang, Jiaqi Liu et al.· Annual Meeting of the Associ...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
