Yu-Long Zu

MP3: Mixed-Precision Pipeline Parallelism Framework for Heterogeneous Edge Devices

Owing to the inherent advantages of edge computing in latency, privacy, and always-on availability, deep neural network (DNN) tasks are progressively shifting to edge devices. However, limited edge resources pose significant challenges for deploying large DNNs. Pipeline parallelism (PP) and post-training quantization (...