2026· IEEE Transactions on Aerospace and Electronic Systems· Vol 62, pp. 15895-15909· 0 citations· 61 references
Abstract
In autonomous driving, achieving accurate and robust 3-D perception through the fusion of multiple sensor modalities is a critical requirement. While camera-based methods operating in the bird’s-eye view (BEV) have shown significant progress, they often suffer from performance degradation under adverse lighting and weather. Furthermore, these vision-based systems struggle with the reliable detection of distant or obscure objects. In this article, we propose radar–camera hybrid fusion (RC-HyFusion), a camera–radar fusion framework that achieves multimodal multistage fusion to generate a better feature representation. First, to address the depth ambiguity in images, sparse but accurate radar points are expanded into pillars in the image dimension to form pseudoimages. Next, multimodal features extracted from the radar pillars and images are sent to the radar–camera adaptive weighted fusion module, where interactive fusion is performed to generate fusion features. Then, fusion features are transformed to the BEV with a view transformation. Meanwhile, the radar-based adaptive sampling module aims to enrich the semantic information of radar points and realize multistage interaction by automatically sampling fusion features based on radar point features under the BEV. Finally, we utilize multimodal BEV features for 3-D detection. The experimental results demonstrate that RC-HyFusion effectively integrates radar and camera information and achieves competitive 3-D object detection performance on the nuScenes benchmark.
SARFusion is proposed, a robust 3D object detector that decouples object-query decoding into three parallel reasoning branches: a camera branch, a LiDAR branch, and a camera-LiDAR fusion branch that alleviates harmful cross-modal interference while preserving the benefits of multimodal fusion when complementary cues ar...
Depth estimation is fundamental to vision applications, but recovering metric depth from a single image remains challenging due to scale ambiguity. Radar-camera depth estimation offers a practical solution by combining dense visual cues with weather-robust radar measurements, yet the extreme sparsity and noise of radar...
Cheng-Hao Zhang, Fu-Yi Zhang, Zhu Yu et al.· IEEE Robotics and Automation...· 0 citations
4D radar-camera fusion has attracted increasing attention for reliable 3D perception under adverse weather conditions. However, existing methods either lose valuable radar information by using sparse point clouds, or suffer from high computation when processing raw tensors directly. To address these challenges, this pa...
Li-Wei Luo, Xia Wu· IEEE Robotics and Automation...· 0 citations
This review offers an all-round synthesis of how LiDAR and camera sensors are integrated for 3D target detection and aims to give a comprehensive theoretical explanation to scholars who have a preliminary understanding of the fusion of LiDAR and camera.
Multimodal perception integrating light detection and ranging (LiDAR) and cameras has become a key paradigm for 3-D object detection, as it leverages both geometric structure and semantic information. However, in real-world autonomous driving scenarios, calibration errors, adverse weather, and sensor degradation can in...
Hui-Lin Huang, Yan Bai, Peng-Yuan Wang et al.· IEEE Sensors Journal· 0 citations
A reliability-gated cross-modal fusion model, RG- CMF, is proposed for complex-scene 3D object recognition that integrates calibration-aware RGB–LiDAR alignment, dual- branch feature extraction, reliability-gated fusion, and geometry–semantic consistency optimization and suggests that explicit reliability modeling can...
Zhongxing Duan· International Conference on...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.