D-MOPD (Dynamic Domain ScheDuling for MOPD), a zero-overhead scheduler that repurposes the per-domain reverse-KL signal already produced during training to adapt the domain mixture online to adapt the domain mixture online.
Zechen Sun, Zhi-Wei Zhang, Fei Zhao et al.· 1 citation
This work proposes SABER, a training-free framework for stability-aware early exit via adversarial branch probing, and shows that SABER reduces reasoning token consumption by 30.2% on average while maintaining competitive accuracy with full-length reasoning.
Wanzhe Cheng, Hai-Yang Xiang, Jun-Tao Li et al.· 1 citation
As the context window of Large Language Models (LLMs) continues to expand, the data required to effectively train and evaluate these capabilities remains underexplored. With existing research primarily focuses on architectural optimization, there is a need for a systematic, data-centric review. This survey bridges th...
Zechen Sun, Yu-Yang Sun, Zhao-yu Su et al.· Transactions of the Associat...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.