A task scheduling method using the Deep Q-Network to determine the computation node for the computation task and a dynamic congestion-aware mechanism to determine a low-cost routing path is proposed, which gradually obtains an effective task scheduling scheme through multiple rounds of alternating iterations.
Abstract
Cloud computing and mobile edge computing address the growing demand for computing power driven by the rise in data-intensive applications, but they are prone to creating computing silos, resulting in unbalanced resource utilization. To address this issue, the computing power network (CPN) has been introduced to enable the centralized management and scheduling of resources across the entire network. However, task scheduling in the CPN requires joint selection of computation nodes and routing paths, which greatly increases the complexity of the scheduling problem. In existing studies, heuristic methods are difficult to satisfy real-time requirements, whereas deep reinforcement learning methods ignore the collaborative optimization of network resources, making them difficult to adapt to complex CPN scenarios. To this end, we propose a task scheduling method for the CPN, called TS-DQNF. First, the method uses the Deep Q-Network (DQN) to determine the computation node for the computation task. Then, it introduces a dynamic congestion-aware mechanism to determine a low-cost routing path. Finally, it gradually obtains an effective task scheduling scheme through multiple rounds of alternating iterations. Simulation results show that the TS-DQNF improves the task success rate by 2.47–60.71% and reduces the average processing delay by 1.92–16.94% compared with other methods, while demonstrating good convergence performance.
Traditional resource scheduling strategies fail to fully utilize the computing and storage resources of edge nodes, leading to resource waste and overload of some nodes. This paper collects network topology and edge node resource information data for preprocessing. Then, a state space and action space are defined to re...
A Mixed Integer Nonlinear Programming (MINLP) model with the objective of a weighted sum of long-term average task completion rate, total latency and energy consumption is established, which improves the task completion rate by 4% in high load scenarios and achieves a better balance between latency and energy consumpti...
Recently, in‐network computing has been proposed as a new paradigm to integrate computation and communication at the network edge, enabling data to be processed while being transmitted toward its destination. To achieve this, the problem of joint optimization of computation path selection and workload allocation has ga...
Junyu Mai, Tian Yang, Ouyang Sheng et al.· Concurrency and Computation· 0 citations
This paper addresses the joint task offloading and resource allocation problem in multi-user MEC systems and proposes a decentralized control framework based on Multi-Agent Reinforcement Learning (MARL), which achieves lower total system cost and faster convergence than the full-local, full-offload, and heuristic basel...
Youssef Oukissou, Mohamed Amine Meddaoui, Ayoub Belaidi et al.· International journal of Com...· 0 citations
Mobile edge computing (MEC) has accelerated the development of artificial intelligence and Internet of Things technologies, leading to the explosive growth of intelligent applications characterized by resource intensity and latency sensitivity, such as image processing and smart home. In practice, an application typica...
Zhixiu Yao, Yun Li, Qilie Liu et al.· IEEE Transactions on Service...· 0 citations
An adaptive Beta-policy and delayed-update multi-agent soft actor-critic method, abbreviated as ABDMASAC, which uses a Beta policy to model bounded actions and achieves a better overall trade-off than the selected MASAC-backbone and on-policy MARL baselines under the considered simulation settings.
Zheng Yao, Jie Liu, Changjun Deng et al.· Computers, Materials & C...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.