Accelerating an Algebraic Multigrid-Based Solver Using Data Processing Units
Abstract
Data processing units (DPUs)-network interface controllers (NICs) with onboard general-purpose processors-have been explored as communication accelerators, but their utility as asymmetric coprocessors for memory-bandwidth-bound scientific HPC workloads remains an open question. We investigate this question in the context of the MiniEM proxy application. Specifically, we accelerate an algebraic multigrid (AMG)-based Maxwell solver, representing a class of solvers whose work decomposes into concurrent, imbalanced subtasks. Our implementation offloads one subtask to NVIDIA BlueField-3 (BF3) DPUs using a heterogeneous SPMD MPI model, requiring no DPU-specific offload framework. We then characterize when this strategy is profitable as a function of the CPU/DPU rank ratio. On a Xeon Broadwell + BF3 cluster and an EPYC Zen2 + BF3 cluster, we measure end-to-end speedups of up to 1.3× and 1.7×, respectively. We also show that as few as 4 of a BF3's 16 cores suffice to outperform the best CPU-only configuration.