Back to #edge computing

AoI Minimization in Heterogeneous MEC Networks: A Federated Learning-Assisted Hybrid DRL and Convex Approach

Sep 2026 · IEEE Transactions on Mobile Computing · Vol 25, pp. 13523-13542 · 8 citations · 43 references

Abstract

This paper investigates a dynamic heterogeneous mobile edge computing network (HMECN), where mobile devices (MDs) could offload their full tasks to a small base station (SBS) directly or the macro base station (MBS) in direct or relay mode. As age of information (AoI) is a comprehensive and accurate metric to capture the freshness of computation results, we formulate a long-term weighted sum AoI (LWSA) minimization problem in the HMECN by jointly optimizing the offloading decisions of MDs as well as the bandwidth and computation resource allocation of all base stations, subject to energy, delay and peak AoI constraints. To address the formulated non-convex mixed integer nonlinear programming problem, we decompose it into the offloading decision optimization (ODO) top-problem and the resource allocation optimization (RAO) sub-problem. Based on the decomposition, we propose a federated learning (FL)-assisted hybrid DRL and convex approach that is comprised of a safe multi-agent DRL algorithm, convex optimization and FL. The ODO top-problem is solved by the safe multi-agent DRL algorithm, which strictly ensures that the actions of each agent do not exceed its energy constraint and then paves the way for using convex optimization to solve the RAO sub-problem. FL is used to alleviate the training instability problem aggravated by multi-agent settings via breaking the limitation of partial knowledge for each individual agent. Simulation results demonstrate the superiority of the proposed approach in terms of the LWSA, convergence, scalability and robustness in dynamic environments.

View source

Similar papers

Open access Jul 2026

Toward Low-Delay and Energy-Efficient UAV-Assisted MEC Systems Through Intelligent Resource Allocation

A Prioritized Adaptive Weighting based on Deep Deterministic Policy Gradient (PAW-DDPG) as an enhanced Deep Deterministic Policy Gradient (DDPG) algorithm to minimize both processing delay and energy consumption by jointly optimizing user scheduling, partial-task offloading, and UAV trajectory is proposed.

W. Saber, Hanan Algamil, Fifi Farouk et al. · 0 citations
Jun 2026

HALO: Hierarchical Auction-assisted Learning for Offloading in SAGIN

HALO, a hierarchical auction-assisted learning framework that combines auction-based task association with hierarchical Proximal Policy Optimization for resource allocation, is proposed, highlighting HALO's ability to maintain stable and efficient performance under varying traffic conditions, making it well-suited for delay-sensitive SAGIN environments.

Xuli Cai, P. Lohan, S. Trankatwar et al. · 0 citations
2026

Mobile-Edge Computing in SAGINs: A Hybrid Action Space P-DDQN Algorithm for Joint Offloading and Resource Allocation

The flexible deployment of uncrewed aerial vehicles (UAVs) and the wide-area coverage of low Earth orbit (LEO) satellites make their integration in space–air–ground integrated networks (SAGINs) a promising solution for communication in resource-constrained remote areas. This paper proposes a SAGIN framework supporting mobile edge computing (MEC) with a three-layer architecture, which provides heterogeneous computing resources for ground Internet of Things (IoT) devices and enables users in remote and underdeveloped regions to access computational services. Our objective is to minimize the weighted sum of energy consumption and latency in the SAGIN subject to satellite coverage time constraints and partial task offloading requirements. The optimization problem is formulated as a mixed-integer nonlinear programming (MINLP) challenge that jointly optimizes the UAV’s three-dimensional trajectory, IoT device association, transmit power, and task assignment. The coupled optimization variables form a hybrid action space with both discrete and continuous actions. To address this challenge, a parameterized double deep Q-network (P-DDQN) algorithm based on deep reinforcement learning (DRL) is proposed. The proposed method employs the DDQN algorithm to handle discrete actions and the deep deterministic policy gradient (DDPG) algorithm to generate continuous actions. Simulation results show that the proposed algorithm outperforms several baseline schemes in terms of system cost, providing an efficient solution for highly coupled hybrid decision optimization problems in SAGINs.

Haosheng Chen, Haixia Cui, Peng Cao et al. · 0 citations
Conference Jul 2026

Edge Computing Control and Task Assignment in Integrated Terrestrial and Non-Terrestrial Networks

Integrated Terrestrial–Non-Terrestrial Networks (ITNTN), which combine terrestrial base stations (BSs), High-Altitude Platform Stations (HAPS), and Low-Earth Orbit (LEO) satellites, are key enablers of 6G communication and edge computing (EC) services. However, energy-limited BSs, particularly HAPS and satellites, pose significant sustainability challenges under continuous operation. To address this issue, we propose an on-demand EC server activation framework integrated with intelligent task offloading across ITNTN. A joint optimization problem is formulated to maximize task offloading success while satisfying energy and quality-of-service requirements. To solve it, we propose an online Q-learning policy that adaptively manages task offloading and EC server activation without prior knowledge of traffic dynamics. Simulation results show that the proposed method achieves superior task offloading success and energy efficiency compared to online heuristic and offline metaheuristic baselines. These findings highlight the importance of energyaware On-Off EC control for sustainable ITNTN systems.

Insaf Rzig, W. Jaafar, Safwan Alfattani · 0 citations

Related blog posts