Deep Reinforcement Learning-Based Energy-Efficient Resource Allocation and Scheduling in 6G-Enabled UAV-Assisted IoT Wireless Networks

Abstract

Unmanned Aerial Vehicles (UAVs) have emerged as a flexible, cost-effective solution for connecting Internet of Things (IoT) devices where traditional infrastructure falls short. However, managing their limited energy alongside the diverse demands of densely deployed devices makes resource allocation a genuinely hard problem. This paper presents a Deep Reinforcement Learning (DRL) framework that jointly optimizes user scheduling, IoT device transmit power, bandwidth, and UAV movement in a 6G-enabled UAV-relay uplink network, using a deterministic large-scale air-to-ground path-loss channel model. The UAV acts as an aerial decode-and-forward relay between IoT devices and a Base Station (BS), with a Deep Q-Network (DQN) making decisions based on queue backlogs, channel conditions, UAV position, and remaining battery. The reward function balances Energy Efficiency (EE), queue stability, fairness, and battery longevity. We benchmark the DQN against six baselines; Round Robin (RR), Random Allocation (RA), the Single-to-Noise Ratio (Max-SNR), Proportional Fair (PF), a Lyapunov heuristic, and a GreedyEE scheme; across a range of device counts, traffic loads, battery budgets, and flight altitudes. Simulations consistently show that the DQN outperforms all baselines, including a RA baseline with equal access to UAV mobility; in EE, throughput, delay, and fairness, confirming that the gain stems from the learned joint control policy rather than from UAV mobility being available.