Generative AI Service Provision in Heterogeneous Edge Networks: A Dynamic Two-Stage Optimization Approach
Generative Artificial Intelligence (GAI) has been attracting a massive and rapidly expanding user base worldwide in recent years, resulting in enormous demand for inference requests that cannot be handled efficiently by centralized cloud-based architectures. Edge computing presents a promising approach to mitigate thes...