Skip to content

RC-HyFusion: Radar–Camera Hybrid Fusion for 3-D Object Detection in Autonomous Driving

2026 · IEEE Transactions on Aerospace and Electronic Systems · Vol 62, pp. 15895-15909 · 0 citations · 61 references

Abstract

In autonomous driving, achieving accurate and robust 3-D perception through the fusion of multiple sensor modalities is a critical requirement. While camera-based methods operating in the bird’s-eye view (BEV) have shown significant progress, they often suffer from performance degradation under adverse lighting and weather. Furthermore, these vision-based systems struggle with the reliable detection of distant or obscure objects. In this article, we propose radar–camera hybrid fusion (RC-HyFusion), a camera–radar fusion framework that achieves multimodal multistage fusion to generate a better feature representation. First, to address the depth ambiguity in images, sparse but accurate radar points are expanded into pillars in the image dimension to form pseudoimages. Next, multimodal features extracted from the radar pillars and images are sent to the radar–camera adaptive weighted fusion module, where interactive fusion is performed to generate fusion features. Then, fusion features are transformed to the BEV with a view transformation. Meanwhile, the radar-based adaptive sampling module aims to enrich the semantic information of radar points and realize multistage interaction by automatically sampling fusion features based on radar point features under the BEV. Finally, we utilize multimodal BEV features for 3-D detection. The experimental results demonstrate that RC-HyFusion effectively integrates radar and camera information and achieves competitive 3-D object detection performance on the nuScenes benchmark.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection

SARFusion is proposed, a robust 3D object detector that decouples object-query decoding into three parallel reasoning branches: a camera branch, a LiDAR branch, and a camera-LiDAR fusion branch that alleviates harmful cross-modal interference while preserving the benefits of multimodal fusion when complementary cues ar...

Yu-Ting Zhao, Zi-Yi Zheng, Shu-Xiao Li · 0 citations
Open access Nov 2026

RadarFuser: One-Stage Radar-Camera Depth Estimation With Early and Point-Guided Fusion

Depth estimation is fundamental to vision applications, but recovering metric depth from a single image remains challenging due to scale ambiguity. Radar-camera depth estimation offers a practical solution by combining dense visual cues with weather-robust radar measurements, yet the extreme sparsity and noise of radar...

Cheng-Hao Zhang, Fu-Yi Zhang, Zhu Yu et al. · 0 citations
Open access Nov 2026

DVFusion: Dual-View Attention and Geometry-Guided Fusion for 4D Radar-Camera 3D Detection

4D radar-camera fusion has attracted increasing attention for reliable 3D perception under adverse weather conditions. However, existing methods either lose valuable radar information by using sparse point clouds, or suffer from high computation when processing raw tensors directly. To address these challenges, this pa...

Li-Wei Luo, Xia Wu · 0 citations
Conference Open access 2026

Automatic Driving 3D Object Detection Based on Lidar and Camera Information Feature Fusion

This review offers an all-round synthesis of how LiDAR and camera sensors are integrated for 3D target detection and aims to give a comprehensive theoretical explanation to scholars who have a preliminary understanding of the fusion of LiDAR and camera.

Yuan Liu · 0 citations
Oct 2026

Robust Multimodal Gated Fusion for 3-D Object Detection via Alignment and Denoising

Multimodal perception integrating light detection and ranging (LiDAR) and cameras has become a key paradigm for 3-D object detection, as it leverages both geometric structure and semantic information. However, in real-world autonomous driving scenarios, calibration errors, adverse weather, and sensor degradation can in...

Hui-Lin Huang, Yan Bai, Peng-Yuan Wang et al. · 0 citations
Conference Sep 2026

Intelligent 3D object recognition in complex scenes based on deep RGB–LiDAR fusion

A reliability-gated cross-modal fusion model, RG- CMF, is proposed for complex-scene 3D object recognition that integrates calibration-aware RGB–LiDAR alignment, dual- branch feature extraction, reliability-gated fusion, and geometry–semantic consistency optimization and suggests that explicit reliability modeling can...

Zhongxing Duan · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.