Preliminary results from a geo-distributed LLM training prototype that treats networking constraints as first-order design concerns are presented, motivating adaptive networking support for synchronization, compression, placement, telemetry, and recovery in geo-distributed LLM training.
Zi-Yue Luo, Jiaxuan Cai, Cedric Le Denmat et al.· Conference on Applications,...· 0 citations
Optimus is a general-purpose model transformation framework built in the PyTorch 2.x (PT2) machine learning compiler that applies an efficient greedy search algorithm for pattern matching and replacement, while preserving model semantic.
Menglu Yu, Jiaqi Xu, Yuzhen Huang et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.