Aug 2026· Remote Sensing· Vol 18, pp. 2715· 1 citation· 48 references
TL;DR
This work proposes a novel architecture that leverages Wavelet Transform Fusion (WTF) and Context-Guided Downsampling (CGD) in the real-time detection transformer (RT-DETR) for small object detection and demonstrates that CGWT-DETR outperforms the RT-DETR baseline in both detection accuracy and computational efficiency.
Abstract
Small object detection (SOD) is a crucial research area in the field of computer vision. It poses significant challenges due to variations in scale, dense objects, limited target resolution, and a complex background. To achieve real-time detection, existing methods typically focus on local feature extraction and employ downsampling to reduce computation. However, this approach lowers the feature map resolution and loses the fine-grained details during downsampling. Meanwhile, frequency, global, and surrounding information play a significant role in small object detection. To address multi-scale dense targets in RGB and thermal infrared imagery with limited spatial, contextual, and frequency information, we propose a novel architecture that leverages Wavelet Transform Fusion (WTF) and Context-Guided Downsampling (CGD) in the real-time detection transformer (RT-DETR) for small object detection. WTF performs multi-frequency feature decomposition and fusion to preserve both high-frequency details and low-frequency semantic information, thereby improving the representation of small targets while reducing computational complexity. CGD incorporates local, surrounding, and global contextual information during downsampling to mitigate spatial information loss and strengthen feature representation for precise object localization. CGD is a downsampling technique that efficiently captures and preserves the contextual spatial information of local and global features using a local feature extractor and a joint feature extractor. It takes into account the surrounding information of the object, thereby reducing the loss of spatial details during downsampling. This spatial information helps in the precise detection of small objects in RGB and thermal infrared aerial images. Our proposed model is evaluated independently on the RGB aerial dataset NWPU-VHR-10 and the thermal infrared dataset HIT-UAV. Evaluations on the NWPU-VHR-10 and HIT-UAV datasets demonstrate that CGWT-DETR improves the mAP@0.50 to 89.9% and 86.5%, respectively, while boosting the strict localization metric mAP@0.50:0.95 to 60.3% and 58.8%. Furthermore, these accuracy gains are achieved alongside a 14.29% reduction in model parameters and a 29.8% decrease in GFLOPs. Experimental results demonstrate that CGWT-DETR outperforms the RT-DETR baseline in both detection accuracy and computational efficiency.
An Inner-SIoU loss is proposed by combining Inner-IoU with SIoU, improving localization accuracy, convergence speed, and robustness in complex scenes, and an Inner-SIoU loss is proposed by combining Inner-IoU with SIoU, improving localization accuracy, convergence speed, and robustness in complex scenes.
Small object detection in remote sensing imagery remains challenging due to the extremely limited pixel footprint of targets and the severe loss of fine-grained spatial details caused by multistage downsampling. To address these issues, we propose WE-DETR, a wavelet-enhanced multiscale feature compensation detection tr...
Yu Song, W. Zuo, Rong-Hua Shang et al.· IEEE Transactions on Geoscie...· 0 citations
Small object detection in uncrewed aerial vehicle (UAV) imagery remains challenging because weak target evidence is easily degraded by repeated downsampling and semantic-spatial misalignment during multiscale fusion. This article presents RSO-DETR, an end-to-end detector built on RT-DETR for UAV small-object detection....
The transformer-based architecture of SRS-DETR exhibits superior detection performance and generalization capability and an Intersection over Union loss function, Dynamic Multi named GWIoU, specifically tailored for small object detection in remote sensing images, to optimize the training process.
Shao-Li Li, Tong-Tong Huang, Chang-Hong Jiang et al.· Engineering Research Express· 0 citations
WS-RTDETR, a robust and efficient detector with a wavelet-guided stage-specific design, is proposed, which demonstrates the effectiveness of WS-RTDETR on an independent hazy UAV benchmark under the same retraining and evaluation protocol.
Tao-Tao Jin, Jia-Qiang Xu, Zhi-Hao Ning et al.· Engineering Research Express· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.