Aug 2026· Measurement science and technology· Vol 37, pp. 325406· 0 citations· 44 references
Physics
TL;DR
A cross-modal fusion (CMFusion) detection framework is proposed, which focuses on efficient multi-level RGB-IR feature interaction within YOLO-based detectors, enabling effective cross-modal complementarity with lower computational overhead.
Abstract
RGB-infrared (RGB-IR) fusion improves object detection by enabling robust object localization under challenging illumination and environmental conditions. However, the additional IR modality often increases computational cost, limiting its deployment in real-time measurement and perception systems. This work revisits cross-modal fusion strategies and shows that strong performance can be achieved by progressively accumulating efficient cross-modal interactions across multiple feature scales, without duplicating auxiliary modality feature-extraction branches. To exploit this observation, a cross-modal fusion (CMFusion) detection framework is proposed, which focuses on efficient multi-level RGB-IR feature interaction within YOLO-based detectors. This design reduces redundant feature extraction within individual modalities while enhancing multi-level multimodal interaction, enabling effective cross-modal complementarity with lower computational overhead. Extensive experiments on three public RGB-IR datasets across two detection tasks (OBB and HBB) demonstrate that CMFusion achieves a 1.7%–6.1% mAP improvement over baseline unimodal detectors while maintaining comparable low computational complexity, and consistently surpasses state-of-the-art methods.
Multi-modal object detection using red-green-blue (RGB) and infrared (IR) imagery is essential for safety-critical applications under diverse illumination conditions, such as autonomous driving and urban surveillance. Recent RGB-IR detectors have improved detection performance through feature-level fusion strategies, i...
Real-time onboard object detection is essential for autonomous UAV applications requiring rapid and reliable decision-making in dynamic environments. Most existing onboard detectors rely on RGB imagery due to its computational efficiency; however, RGB-based models suffer significant performance degradation under low-il...
N. Habash, Ahmad Abu Alqumsan, Tao Zhou· Neural computing & applicati...· 0 citations
Small-object detection under low illumination remains a persistent challenge in aerial surveillance, nighttime patrol, and safety-critical vision tasks, where single-modality sensors—RGB or infrared alone—provide degraded or incomplete target information. This paper proposes an RGB-T object detection network that combi...
A multi-modal cross-attention cross-attention fusion network named MCF-Net is proposed, based on cross-modal attention and difference convolution, designed for tri-modal fusion and remains effective for bi-modal settings.
Ming-Chun Li, Xin-Ran Wu, Rui Wang et al.· Electronics· 0 citations
Accurate object detection in complex environments involving adverse weather, occlusion, and insufficient illumination poses a persistent challenge for autonomous driving and intelligent surveillance systems. Single-modality approaches based on cameras or LiDAR alone often fail under these conditions due to inherent sen...
Yanjun Pu· International Conference on...· 0 citations
Object detection using visible–infrared images has become increasingly important for all-day detection scenarios. However, due to significant imaging discrepancies between the visible and infrared modalities, achieving accurate modal alignment and effective feature fusion remains a major challenge. Existing methods oft...
Kai-Yue Men, Cheng-You Wang, Xiao Zhou et al.· IEEE Transactions on Geoscie...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.