Book
Open access
Jul 2026
COMETS: Cost-effective Multi-node Efficient Training System with Memory Pooling and Sharing
By enabling scalable GPU memory expansion and introducing an alternative inter-node data path, COMETS reduces reliance on NIC-based inter-node networking and supports efficient training across diverse cluster environments and proposes a heterogeneous-aware training strategy to identify optimal training configurations.
Hanqiu Chen, Shao-Peng Yang, Mohammadreza Soltaniyeh et al.
· International Conference on... · 0 citations