Zhao-Wu Huang

AccSI: Accelerating Serverless Inference via Edge-Assisted Pipelined Model Fetching

Serverless edge computing (SEC) is an emerging paradigm for delivering low-latency and auto-scaling services on resource-limited edges. However, when applied to DNN inference applications, SEC suffers from significant cold-start overhead, because large model parameters need to be fetched from remote model registries be...