Preprint
Oct 2026
Mosaic: GPU Sharing with Latency Guarantees through Kernel-Level Interference Prediction
GPUs are increasingly in demand for AI workloads, yet often remain substantially underutilized, motivating workload colocation. However, colocation introduces interference that can degrade latency-critical workloads. Existing approaches mitigate interference using either heuristic-based scheduling or interference predi...
F. Strati, Ethan Graham, Leo Stephan et al.
· 0 citations