2026· IEEE Transactions on Automation Science and Engineering· Vol 23, pp. 18475-18496· 0 citations· 56 references
TL;DR
A Self-Organizing Federated Reinforcement Learning (SO-FRL) framework for cloud-edge-vehicle collaboration that combines a self-organizing network with federated node-level knowledge transfer, enabling continual policy evolution without directly sharing raw trajectories or sensor streams.
Abstract
Cross-scenario collaborative trajectory planning can improve Automated Valet Parking (AVP) by transferring policy knowledge learned from vehicle experiences in different environments. However, existing transfer approaches often rely on static architectures, coarse representations, and limited adaptability, restricting continual knowledge sharing across heterogeneous scenarios. We propose a Self-Organizing Federated Reinforcement Learning (SO-FRL) framework for cloud-edge-vehicle collaboration. The vehicle layer performs local perception and real-time planning, the edge layer aggregates vehicle-level knowledge into parking-lot repositories, and the cloud layer integrates multi-scenario knowledge for cross-scenario generalization. SO-FRL combines a self-organizing network with federated node-level knowledge transfer, enabling continual policy evolution without directly sharing raw trajectories or sensor streams. Experiments in controlled simulations constructed from multiple real parking-lot maps show that SO-FRL achieves the highest measured success rate and success-weighted path efficiency among the tested learning-based and classical baselines, reaching $79.0\% \pm 1.5\%$ SR and $0.60 \pm 0.04$ SPL. It also yields lower and more consistent navigation error while maintaining a compact knowledge structure and acceptable computational complexity. Note to Practitioners—This paper introduces an SO-FRL framework for cross-scenario trajectory planning and adaptive knowledge sharing in autonomous valet parking. By continually compressing and evolving a cloud-edge-vehicle node-based knowledge repository, SO-FRL is designed to reduce onboard model size and uplink traffic by exchanging compact knowledge nodes rather than raw trajectories or raw sensor streams. The current evaluation is conducted in a controlled simulator built from real parking-lot map files, including parking-space layouts, lane geometry, drivable boundaries, and entrance/exit markers. Therefore, the results should be interpreted as real-map-based algorithmic validation rather than field-deployment evidence. The present study does not yet include real-vehicle experiments, digital-twin deployment, or validation in a high-fidelity sensor/traffic simulator. Communication delay and packet loss, unstable edge connectivity, localization error, sensor noise, dynamic pedestrian behavior, unexpected obstacles, cybersecurity risks, and edge-server failures remain to be evaluated in future deployment-oriented validation.
The proposed Forecast-SAC framework demonstrates that unified predictive-control learning enables safe and efficient UAV-BS navigation under dynamic uncertainty, achieving a strong safety–throughput balance that reactive methods cannot match in high-risk environments.
Tariq, Zhuo-Xiu Wei, K. Shaukat et al.· Scientific Reports· 0 citations
MA-PMBRL, a novel Multi-Agent Pessimistic Model-Based Reinforcement Learning framework for CAVs, incorporating a max-min optimization approach to enhance robustness and decision-making is proposed, demonstrating that the proposed framework represents a significant step toward scalable, efficient, and reliable multi-age...
Ruo-Qi Wen, Rong-Peng Li, Xing Xu et al.· IEEE Transactions on Mobile...· 1 citation
This study presents a hierarchical cooperative control framework for hybrid electric vehicles in intelligent transportation systems, termed “cloud-coordinated cooperative driving with deep reinforcement learning.” The framework integrates reinforcement learning with model predictive control (MPC) to balance adaptabil...
Ning Tong, Shi-Fan Luo, Hao Li et al.· Transportation Research Reco...· 0 citations
Simulation results demonstrate that, compared to traditional methods, GS-MADDPG improves the navigation success rate, robustness, and generalization performance, and verifies its effectiveness in multi-UAV cooperative navigation for search and rescue tasks.
Li Tan, Hai-Xia Zhao, Jia-Qin Chai et al.· Unmanned Systems· 0 citations
Ramp-merging areas on freeways are critical nodes for traffic flow transitions but often suffer from low efficiency and elevated safety risks because of multi-vehicle conflicts. This study proposes a distributed decision-making architecture for multilane ramp lane-changing and merging scenarios and develops a Maneuver-...
Shuai-Jun Guo, Fei Liu, Zi-Mo Chen et al.· Transportation Research Reco...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.