<inline-formula><tex-math notation="LaTeX">${\sf BandPilot}$</tex-math><alternatives><mml:math><mml:mi mathvariant="sans-serif">BandPilot</mml:mi></mml:math><inline-graphic xlink:href="tang-ieq1-3716225.gif"/></alternatives></inline-formula>: Toward Performance- and Contention-Aware GPU Dispatching
Modern multi-tenant AI clusters are increasingly communication-bound, driven by high-volume and multi-round GPU-to-GPU collective communication. Consequently, the GPU dispatcher’s choice of a physical GPU subset for each tenant largely determines the job’s effective collective bandwidth and thus its performance ceiling...