The Message Passing Interface (MPI) is widely adopted in high-performance computing (HPC) systems to support scalable inter-process communication. While HPC systems are theoretically expected to offer high performance, they often fall short in practice due to the overhead from MPI. In particular, MPI collective communi...
Seon Young Kim, Hooyoung Ahn, Jaewon Lee et al.· IEEE International Conferenc...· 0 citations
Data preprocessing is a crucial part of deep learning workflows on edge devices. However, decoding data saved in JPEG format is very compute-intensive and occupies a major portion of the preprocessing pipeline. Therefore, increasing the decoding speed is vital for improving overall throughput, especially for inputs wit...
Tianrun Chen, Nawras Alnaasan, Jinghan Yao et al.· 0 citations
This work presents HAT-MPI, an ML-based framework that identifies the UCX Eager-Rendezvous protocol threshold and the optimal collective algorithm on InfiniBand HPC clusters and introduces two complementary techniques that improve the conventional data collection and evaluation workflow, namely LLM-assisted HPC hardwar...
Sungjae Lee, Sam Tilford, Dhabaleswar K. Panda· IEEE International Symposium...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.