Skip to content
#edge computing Open access

Dynamics-Aware Hierarchical MADRL for Aerial-Terrestrial Cooperation in Vehicular Computation Offloading

Dec 2026 · IEEE Transactions on Mobile Computing · Vol 25, pp. 23847-23864 · 0 citations · 52 references

TL;DR

This work proposes a Dynamics-Aware Hierarchical Multi-Agent (DHMA) deep reinforcement learning approach that jointly optimizes UAV position scheduling and vehicular computation offloading and develops a prediction-driven observation augmentation method to enhance the perception capabilities of agents for future dynamics based on predicted workload surges and vehicular movements.

Abstract

Multi-access edge computing provides an effective computation offloading paradigm for resource-constrained vehicles by deploying resources at network edges. However, high vehicular mobility and heterogeneous task demands lead to spatio-temporal load imbalances across static roadside units (RSUs). Prior works either lack responsiveness to sudden workload surges or exhibit poor robustness under sustained fluctuations. To fill this gap, we explore an aerial-terrestrial cooperative design, leveraging UAV assistance and cross-RSU task migration to enable responsive surge absorption and system-wide robustness. Nevertheless, achieving preemptive UAV position scheduling and anticipatory cross-RSU task migration remains challenging. We argue that proactive prediction of future dynamics is crucial for guiding timely and collaborative decision-making. On this basis, we propose a Dynamics-Aware Hierarchical Multi-Agent (DHMA) deep reinforcement learning approach that jointly optimizes UAV position scheduling and vehicular computation offloading. Additionally, we develop a prediction-driven observation augmentation method to enhance the perception capabilities of agents for future dynamics based on predicted workload surges and vehicular movements. Comprehensive evaluation across four simulation scenarios, together with real-world validation, demonstrates the effectiveness, robustness, and practical viability of our approach.

Read PDF

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

Microsoft Research Blog Oct 29, 2026

Microsoft Research Focus – Edition #97

Host Sowbhagya Suresh shares some of the latest news and cutting-edge research from across Microsoft—from understanding the challenges facing coding agents to uncovering how people use AI at work and improving extended-range weather forecasting. The post Microsoft Research Focus – Edition #97 appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 21, 2026

Solving a 31-year-old grand challenge in mathematics – the KLS conjecture

For decades, a fundamental question about the difficulty of computing in high-dimensional spaces has resisted proof. New research resolves this question, removing a major theoretical obstacle to understanding the efficiency of randomized algorithms used across science and computing. The Kannan–Lovász–Simonovits (KLS) conjecture was proposed in 1995. It asks whether, for a broad class of high-dimensional […] The post Solving a 31-year-old grand challenge in mathematics – the KLS conjecture appear…

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.