Significance-Aware Federated Reinforcement Learning for AoI Optimization of Vehicular Sensing in UAV-Assisted Edge Networks

Abstract

Timely vehicular sensing is important for traffic monitoring, cooperative driving, and road-safety management. High mobility, time-varying wireless conditions, and limited edge resources nevertheless make information freshness difficult to maintain. This paper studies age of information (AoI) minimization in a three-layer UAV-assisted edge network comprising vehicle devices (VDs), unmanned aerial vehicles (UAVs), and a cloud center (CC). VDs periodically generate sensor-data packets, UAVs provide mobile edge processing and data-relaying services, and the CC coordinates system-wide resource allocation. The joint optimization of sensor-data transmission, UAV movement, packet processing, computation offloading, and bandwidth allocation is formulated within a cooperative multi-agent framework. To solve this problem, we propose a collaborative heterogeneous federated actor–critic (CHFAC) framework. Its significance-aware federated learning mechanism evaluates local model updates according to update significance, alignment with the global learning direction, and training stability and uses the resulting contribution scores for non-uniform agent selection and contribution-weighted aggregation. In the considered simulation setting, evaluation over 1000 test episodes yields an average AoI of 7.45±1.65 and a worst-case AoI of 38.72±24.06. The average AoI is 79.0%, 63.9%, and 29.2% lower than that obtained by the implemented HF-MARL, H-MAAC, and non-federated baselines, respectively. These results demonstrate the effectiveness of CHFAC for freshness-aware vehicular sensing in dynamic UAV-assisted edge environments.