TopoGraph-Fusion: Hierarchical Task-Conditioned Topology Reasoning for RGB–Thermal Object Detection

Abstract

Robust object detection for autonomous driving requires perception models that remain reliable when visible imagery is degraded by darkness, glare, rain, fog, motion blur, or long-range small targets. Visible and thermal infrared cameras provide complementary evidence, yet many RGB–thermal detectors fuse modalities, mainly as aligned tensors, and may underuse relational structure in channel responses, spatial layouts, semantic scales, and modality-specific uncertainty. This paper presents TopoGraph-Fusion, a hierarchical graph-guided dual-modal object detector that formulates fusion as topology-aware reasoning rather than direct feature concatenation. The proposed framework builds a dual-stream backbone for RGB and thermal images, constructs channel-wise topology through a channel-topology graph aggregation module, derives relation-aware spatial and channel global attention from affinity graphs, and replaces fixed feature-pyramid communication with a Graph-Guided Feature-Pyramid Network. A topology-regularized detection objective further encourages stable cross-modal correspondence while suppressing noisy all-to-all connections. Experiments on M3FD, FLIR, RGBTDronePerson, and VEDAI512 cover road scenes, adverse illumination, drone–person perception, and aerial vehicle detection. Within this validation scope, the results and visual analyses indicate that topology-guided fusion improves small-object recall, cross-modal consistency, and robustness under modality imbalance.