Aug 2026· Journal of Marine Science and Engineering· Vol 14, pp. 1541· 0 citations· 22 references
TL;DR
Extensive simulations conducted under diverse single- and multi-vessel encounter scenarios quantitatively demonstrate that the proposed method substantially reduces collision and COLREGs violation rates compared to baseline DRL-only or reward-shaping methods, while maintaining excellent computational scalability and real-time responsiveness.
Abstract
This study proposes a safety-enhanced path planning system that integrates a Control Barrier Function (CBF)-based Safety Shield with Deep Reinforcement Learning (DRL). This framework addresses the critical limitations of conventional DRL-based Unmanned Surface Vehicle (USV) navigation models, which can output hazardous control commands in edge cases and violate the International Regulations for Preventing Collisions at Sea (COLREGs). The proposed system continuously operates during navigation via an Encounter Classifier that identifies multi-vessel situations (such as Head-on, Crossing, and Overtaking) in real time. The nominal control inputs generated by the DRL policy are verified and safely filtered through a Control Barrier Function-Quadratic Programming (CBF-QP) optimization layer immediately prior to execution, incorporating ship safety radii and asymmetric COLREGs constraints. Furthermore, we introduce a ‘Shielded Training’ mechanism that penalizes the agent based on the magnitude of the shield’s interventions during the training loop. This effectively diminishes the policy’s over-reliance on the safety filter and guides the network toward discovering robust, inherently safe trajectories. Extensive simulations conducted under diverse single- and multi-vessel encounter scenarios quantitatively demonstrate that the proposed method substantially reduces collision and COLREGs violation rates compared to baseline DRL-only or reward-shaping methods, while maintaining excellent computational scalability and real-time responsiveness. Consequently, by unifying the adaptive environmental exploration of reinforcement learning with model-based runtime safety constraints derived from control theory, this study provides a practical runtime assurance framework for future marine deployment.
Deep reinforcement learning (DRL) provides an end-to-end approach to collision avoidance for uncrewed surface vehicles (USVs). However, it typically exhibits inadequate threat perception capabilities and low sample efficiency in complex environments. To address these challenges, a DRL-based framework that couples beam-...
This work proposes RLTrajGen-PPMPC-CBF, a hierarchical framework for safe, smooth and comfort roundabout navigation, which regulates the coupling between RL-based planning and MPC-based control, and employs Prescribed Performance Constraints (PPC) to enforce a gradual, stable convergence between reference trajectories...
Wen-Han Li, Yang-Rui Zhang, Hang Zhou et al.· 0 citations
In this study, we present a safety-critical control framework for autonomous vehicles (AVs) that integrates model predictive path integral (MPPI) control with control barrier functions (CBFs). The framework ensures trajectory tracking along planned paths while maintaining safety and control constraints by combining sam...
Natnael M. Negash, Yan-Wen Yang, Shu-Xia Tang et al.· IEEE Open Journal of Control...· 0 citations
Robots operating in human-centered environments must safely navigate among multiple dynamic obstacles to avoid collisions with people and surrounding infrastructure. Control barrier functions (CBFs) provide an effective mechanism for safety filtering, and recent CBF-based reinforcement learning (RL) methods embed such...
Sanghyuk Park, Kwan-Woo Lee, Taekyung Kim et al.· 0 citations
Autonomous mobile robots require timeefficient planning and safety-critical dynamic obstacle avoidance under constrained onboard computation. While Iterative Learning Planning (ILP) offers lightweight and efficient traversal planning, it lacks explicit mechanisms for dynamic obstacle perception and avoidance. This arti...
Zhi-Yi Chen, Shu-Li Lv, Chen Min et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.