Chenchen Liu

GACER-M: Granularity-Aware and Memory-Centric Coordination for Multi-Tenant Deep Learning

Multi-tenant computing, which executes multiple neural networks on a single GPU, is essential for maximizing hardware utilization in both cloud and edge environments. However, effective co-location faces a fundamental trade-off between utilization and safety. On one hand, the diverse computing patterns of concurrent mo...