A Lighting-Aware Infrared–Visible Image Fusion Network for Security Surveillance

Abstract

Infrared and visible image fusion combines the thermal cues captured by infrared sensors with the rich structural and texture information provided by visible images. This technique is particularly valuable for security surveillance, nighttime scene perception, and target recognition under challenging environmental conditions. Existing methods generally adopt fixed fusion strategies and neglect dynamic dual-modality changes under low illumination, overexposure and strong light interference, failing to preserve both thermal target saliency and visible structural details in fused images. To address this problem, this paper proposes a Lighting-Aware Spatial–Frequency Fusion Network (LASFNet) for security surveillance. It first estimates modality reliability across low-light, overexposed and infrared-salient regions, incorporating it into the fusion of frequency-domain amplitude and phase. Spatial infrared, visible and frequency-domain compensation features are then jointly fused to generate the output. Experiments on M3FD, MSRS and RoadScene datasets show that LASFNet achieves competitive fusion performance with strong cross-dataset generalization. On M3FD, YOLOv8s with LASFNet-fused inputs achieves 84.825% mAP@0.5 and 57.319% mAP@0.5:0.95, outperforming visible, infrared and YDTR-fused inputs. The proposed method balances target saliency and scene structure, providing more effective visual input for object detection under complex illumination.