Several works have explored multi-agent reinforcement learning (MARL) in LLM collaboration. However, constructing reliable rewards is difficult in practice, as complete and accurate metrics are often unavailable and hard to aggregate. Preference learning provides an alternative by learning from comparative human or AI...
Shuo Liu, Xinzichen Li, Tian-Le Chen et al.· 0 citations
Counteraction-Aware Multi-Teacher On-Policy Distillation is proposed, which addresses issues with decoupled alternating training and gap-based sample selection and outperforms all baselines in general capability recovery while maintaining domain-specific behavior.
Tian-Le Chen, Jiao Ou, Zi-Yuan Liu et al.· arXiv.org· 13 citations· ⚡1
ReCo (Reward-Coordinated Compression), a step-wise framework in which a lightweight process-reward estimator scores each completed step and drives three components: reward-adaptive KV-cache compression that shrinks the retained cache harder at high-reward steps and less at low-reward ones, and a confidence-based early...
Qi-Yuan Zhu, De-Zhi Li, Pengyu Cheng et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.