2026· IEEE Transactions on Communications· Vol 74, pp. 13930-13945· 0 citations· 40 references
Abstract
Intelligent transportation systems face dual challenges in achieving efficient synergy between sensing and edge computing, arising from dynamic environments and unstable communication channels. Unlike existing approaches that rely on perfect channel state information (CSI) or assume static environments, this paper proposes a deep deterministic policy gradient (DDPG)-based offline-online joint optimization (OOJO) framework for trajectory optimization and resource allocation in a reconfigurable intelligent surface-assisted unmanned aerial vehicle (UAV) integrated sensing and edge computation system. Imperfect CSI and highly dynamic vehicle mobility are explicitly modeled, formulating a mixed-integer non-convex problem to minimize the total sum of the maximum end-to-end latency across all UAVs. The proposed centralized single-agent OOJO framework employs an actor-critic network to output continuous control actions, enabling closed-loop optimization from sensing to scheduling. During offline learning, general policies are learned from historical data; during online learning, strategies are rapidly adapted to dynamic environmental changes. Simulation results show that the proposed DDPG algorithm outperforms the Deep Q-Network by 21.2% while maintaining low latency across varying vehicle speeds and imperfect CSI, validating its practicality and efficiency in complex dynamic traffic scenarios.
This paper proposes a heterogeneous multi-agent proximal policy optimization (MAPPO)-based framework where both user devices and UAVs act as heterogeneous agents and utilizes a centralized training and decentralized execution (CTDE) paradigm to enable collaborative strategies between computing requesters and providers.
Ming Cheng, Canlin Zhu, Jian-Hang Tang et al.· Journal of King Saud Univers...· 0 citations
This paper proposes AERIS, an offline policy improvement framework for multi-UAV ISAC that learns from fixed flight logs under centralized training and decentralized execution and designs STAR-CRDT, an offline multi-agent RL algorithm that performs support-aware local action rectification and distills only trusted impr...
Ziyuan Wang, Yi-Fan Sui, Wei Wei et al.· 0 citations
This paper investigates an energy efficiency maximization problem in a UAV-assisted WPCN by jointly optimizing the UAV trajectory, hovering altitude, and hybrid TDMA/NOMA resource allocation and proposes a deep reinforcement learning-driven Hierarchical Energy-Efficient Data Collection scheme, which is named DRL-HEEC.
Si-Liang Gong, Kai-Yang Qu, Qi-Sen Wang et al.· Electronics· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.