Lannie Dalton Hough

Adaptive Space-efficient Collectives for Dynamic and Unstructured Sparsity on GPU Platforms

High-performance collective communication primitives are necessary for a variety of high performance computing (HPC) and machine learning (ML) workloads. State-of-the-art collective communication libraries such as NCCL optimize exclusively for dense data. However, when sending sparse data, we can reduce communication v...