Training large language models (LLMs) is resource-intensive, and adapting them for diverse deployment scenarios with varying computational constraints remains challenging. While elastic architectures enable flexible model deployment and sparsely activated models allow input-adaptive computation, existing approaches tre...
Arnav Kundu, Zhao-Yang Xu, Bai-Ru Hou et al.· 0 citations
On-Policy Omni Distillation (OPOD), which consolidates text, image, and audio teachers into one omni model, and surpasses the base model and pooled RL training on all twelve benchmarks, and ranks first or second on eleven even when the teachers are included.
Tong Zhao, Yuyang Hu, Reed Li et al.· arXiv.org· 0 citations
This work introduces a generalizable evaluation framework that maps native MAS traces into a shared space of unified collaboration graphs, enabling different methods to be evaluated under the same representation, reference set, and metric panel.
Guo Chen, Ziwen Li, Reed Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.