Large-model parameters have grown beyond the capacity of a single xPU, dispersing across multiple xPUs spanning distinct host domains, where xPU-to-xPU communication dominates overall system efficiency. Existing scale-up interconnect remains inadequate: network-based solutions built on Ethernet--such as RoCE (RDMA over...
Zhe-Zhe Peng, Jia-Ming Huang, Chao-Fan Chen et al.· 0 citations
Miles v0.1 is presented, a full-stack, production-ready system for frontier post-training reinforcement-learning training, which supports LoRA RL, on-policy distillation, supervised fine-tuning, and true-on-policy rollout-training alignment, and extends the same architecture to diffusion models.
R. Chen, Ma Cheng, Shi Dong et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.