Skip to content
Conference Open access

REACH: Reinforcement Learning for Adaptive Microservice Rescheduling in the Cloud–Edge Continuum

Oct 2025 · IEEE International Conference on Cloud Computing · pp. 32-42 · 0 citations · 29 references
Computer Science

TL;DR

REACH is proposed, a reinforcement learning-based microservice rescheduling framework that enables a sim-to-real deployment pipeline for adapting microservice placement under fluctuating resource availability and performance variations across distributed infrastructures.

Abstract

Cloud computing, despite its scalability advantages, may not fully satisfy the low-latency demands of emerging latency-sensitive applications. The cloud–edge continuum addresses this limitation by integrating the responsiveness of edge resources with cloud scalability. Microservice architecture (MSA), characterized by modular, loosely coupled services, aligns effectively with this continuum. However, heterogeneous and dynamic computing resources pose significant challenges to optimal microservice placement. Most existing approaches focus on generating one-time scheduling plans, which are ill-suited to dynamic environments where frequent and lightweight rescheduling actions are required in response to changing system conditions. We propose REACH, a reinforcement learning-based microservice rescheduling framework that enables a sim-to-real deployment pipeline for adapting microservice placement under fluctuating resource availability and performance variations across distributed infrastructures. REACH is integrated with a real Kubernetes-based cloud–edge continuum testbed, with open-source artifacts released for reproducibility.

Read PDF

Similar papers

Open access Sep 2026

Multi-Objective DRL for Efficient Kubernetes Microservice Scheduling

Container based microservice architecture is becoming the priority of service development in edge computing. Its flexibility and scalability could provide stable service response. However, due to the limited computing resources of each edge node in edge computing, how to use computing resources efficiently has become an important issue in microservice deployment. This study formulates the multi-objective microservice deployment problem (MMDP) in Kubernetes, balancing service latency and resource utilization. We propose a deep reinforcement learning method with reward shaping and heuristic scaling to derive optimal deployment policies. Experiments show that our approach reduces response time by 25–30% and improves load balancing by 20% compared with Kubernetes default scheduling and DQL. These results demonstrate the applicability of reinforcement learning for distributed computing and automatic control in microservice systems.

Hao Feng, Yun-Mei Shi, Ming-Kai Zhen · 0 citations
Open access 2021

Reinforcement Learning for Adaptive Resource Management in Cloud Software

Reinforcement learning-based adaptive resource management framework is proposed that enables cloud systems to autonomously learn optimal resource allocation policies through continuous interaction with the environment and significantly outperforms static and reactive baseline strategies in terms of resource utilization efficiency and response time stability.

Rajesh Sharma, Priya Natarajan · 0 citations
Preprint Aug 2026

Multi-Agent Transformer for Queue-Level XR Traffic Scheduling in TSN Networks

The multi-agent transformer (MAT) is adopted to model inter-queue dependencies via attention over agents' observations and actions, enabling implicit coordination across heterogeneous co-located XR applications and results show that the proposed method outperforms baselines.

Marcos Carvalho, Fatih Temiz, Shavbo Salehi et al. · 0 citations
#reinforcement learning Open access Aug 2026

Asynchronous Federated Reinforcement Learning for Adaptive Resource Slicing and Low-Latency Task Offloading in Heterogeneous 6G Edge Computing Networks

AF-EdgeRL is proposed, a novel Byzantine-resilient Asynchronous Federated Reinforcement Learning framework tailored for distributed resource allocation and dynamic task offloading and establishes theoretical convergence guarantees under non-convex reinforcement learning objectives.

Daniel Merrow, Tember L. Nair, Lucas Farnandez · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.