Oct 2025· IEEE International Conference on Cloud Computing· pp. 32-42· 0 citations· 29 references
Computer Science
TL;DR
REACH is proposed, a reinforcement learning-based microservice rescheduling framework that enables a sim-to-real deployment pipeline for adapting microservice placement under fluctuating resource availability and performance variations across distributed infrastructures.
Abstract
Cloud computing, despite its scalability advantages, may not fully satisfy the low-latency demands of emerging latency-sensitive applications. The cloud–edge continuum addresses this limitation by integrating the responsiveness of edge resources with cloud scalability. Microservice architecture (MSA), characterized by modular, loosely coupled services, aligns effectively with this continuum. However, heterogeneous and dynamic computing resources pose significant challenges to optimal microservice placement. Most existing approaches focus on generating one-time scheduling plans, which are ill-suited to dynamic environments where frequent and lightweight rescheduling actions are required in response to changing system conditions. We propose REACH, a reinforcement learning-based microservice rescheduling framework that enables a sim-to-real deployment pipeline for adapting microservice placement under fluctuating resource availability and performance variations across distributed infrastructures. REACH is integrated with a real Kubernetes-based cloud–edge continuum testbed, with open-source artifacts released for reproducibility.
Container based microservice architecture is becoming the priority of service development in edge computing. Its flexibility and scalability could provide stable service response. However, due to the limited computing resources of each edge node in edge computing, how to use computing resources efficiently has become an important issue in microservice deployment. This study formulates the multi-objective microservice deployment problem (MMDP) in Kubernetes, balancing service latency and resource utilization. We propose a deep reinforcement learning method with reward shaping and heuristic scaling to derive optimal deployment policies. Experiments show that our approach reduces response time by 25–30% and improves load balancing by 20% compared with Kubernetes default scheduling and DQL. These results demonstrate the applicability of reinforcement learning for distributed computing and automatic control in microservice systems.
Hao Feng, Yun-Mei Shi, Ming-Kai Zhen· INTERNATIONAL JOURNAL OF COM...· 0 citations
Sensitivity and ablation studies confirm stable learning and controllable latency-cost trade-offs, demonstrating that lightweight RL can effectively deliver cost-efficient, adaptive autoscaling in hybrid cloud environments.
Bekzat Kobei, N. Seilova, Zarina A. Kashaganova· AI@DTESI· 0 citations
Reinforcement learning-based adaptive resource management framework is proposed that enables cloud systems to autonomously learn optimal resource allocation policies through continuous interaction with the environment and significantly outperforms static and reactive baseline strategies in terms of resource utilization efficiency and response time stability.
Rajesh Sharma, Priya Natarajan· International Journal of Mac...· 0 citations
The multi-agent transformer (MAT) is adopted to model inter-queue dependencies via attention over agents' observations and actions, enabling implicit coordination across heterogeneous co-located XR applications and results show that the proposed method outperforms baselines.
Marcos Carvalho, Fatih Temiz, Shavbo Salehi et al.· 0 citations
AF-EdgeRL is proposed, a novel Byzantine-resilient Asynchronous Federated Reinforcement Learning framework tailored for distributed resource allocation and dynamic task offloading and establishes theoretical convergence guarantees under non-convex reinforcement learning objectives.
Daniel Merrow, Tember L. Nair, Lucas Farnandez· International Journal of App...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.