Skip to content
Review

Blurring Modal Boundaries: A Unified Survey from Single- to Multi-Modal Person Re-ldentification

Jul 2026 · arXiv.org · Vol abs/2607.14821 · 0 citations
Computer Science

TL;DR

A Transformer-based baseline framework for visible-infrared ReID is proposed, designed to effectively capture modality-invariant features and outline several promising directions for future research.

Abstract

Person re-identification (ReID) serves as a critical component in intelligent surveillance systems, aiming to match identities across disjoint camera networks. While traditional methods primarily rely on single-modal RGB imagery, they are often constrained by environmental challenges such as low illumination and occlusion. To overcome these limitations, the field is rapidly evolving toward cross-modal and multi-modal paradigms. This survey presents a comprehensive overview of this transition, systematically reviewing key cross-modal tasks including visible-infrared (VI-ReID), text-image (TI-ReID), sketch-based (Sketch-ReID), and the emerging Non-Line-of-Sight (NLOS) ReID, which extends perception beyond direct visibility. Furthermore, we examine tri-spectral and multi-modal fusion ReID, discussing how complementary information from diverse sensors enhances robustness. Beyond summarizing datasets, challenges, and methodologies, we propose a Transformer-based baseline framework for visible-infrared ReID, designed to effectively capture modality-invariant features. Finally, based on the current landscape, we outline several promising directions for future research.

View source

Similar papers

Preprint Aug 2026

Multi-scale Decomposed Convolution Refinement Network for Visible-Infrared Person Re-Identification

This work proposes MDCRNet, a Multi-scale Decomposed Convolution Refinement Network that enhances cross-modal feature learning and discriminative metric learning, and develops a Joint Discriminative Metric Loss incorporating a novel Granularity Discriminative Loss (GDL).

Mingsheng Zheng, Zirui Jiang, Bo Liu et al. · 0 citations
#computer vision Preprint Aug 2026

A2DINOv3: Rethinking Multi-Modal Object Detection via Socialized Collaboration

Multi-modal object detection is essential for robust scene understanding in challenging conditions, including low-light and adverse environments. Recent vision foundation models (e.g., DINOv3) have exhibited strong representation capabilities, yet adapting them to multi-modal scenarios remains challenging. Existing dense cross-modal fusion strategies often force heterogeneous modalities to interact indiscriminately, which may introduce redundant information and disrupt the valuable pre-trained representations. To address this issue, we revisit multi-modal fusion from the perspective of socialized learning and propose adapter to DINOv3 (A2DINOv3), a multi-expert collaboration framework with a Socialized Collaboration Protocol (SCP). Specifically, RGB and infrared branches are modeled as heterogeneous experts that independently preserve their specialized knowledge while exchanging complementary information through selective and constrained interactions. This design mitigates harmful cross-modal interference and prevents degradation of pre-trained priors during adaptation. Furthermore, a zero-initialization strategy is introduced to gradually activate cross-modal collaboration, enabling a smooth transition from modality-specific learning to cooperative representation learning. Extensive experiments on four multi-modal benchmarks, including aerial detection (GAIIC), autonomous driving (FLIR), low-light surveillance (LLVIP), and diverse real-world scenarios (M3FD), demonstrate that A2DINOv3 consistently achieves state-of-the-art performance in multi-modal object detection.

Jiekang Feng, Zhihe Fan, Yunqi Zhu et al. · 0 citations
Aug 2026

Progressively Biased Split Vision Transformer Learning for Visible-Infrared Person Re-Identification

A Progressively Biased Split Vision Transformer (PBSVT) is proposed, which combines a split ViT backbone with progressive bias training to gradually reduce RGB-dominant bias while preserving modality-shared structure and demonstrates the effectiveness of progressive modality transition for robust VI-ReID representation learning.

Mengru Jiao, Xin-Yue Xu, Junfeng Zhang · 0 citations
Aug 2026

Decoupled information-guided cross-modal alignment for visible-infrared person re-identification.

Visible-infrared person re-identification (VI-ReID) is an important technique for around-the-clock person matching, and its primary challenge arises from substantial cross-modal discrepancies. To address this challenge, we propose a Decoupled Information-Guided Cross-Modal Alignment (DIGCA) framework organized into three stages: multi-scale feature modeling, partial functional decoupling, and guided cross-modal alignment. First, a Hierarchical Context Extractor (HCE) aggregates multi-scale contextual information through dilated convolutions and residual connections to enrich the initial identity representation. Second, a Multi-Branch Unified Encoder (MBUE) organizes complementary feature streams through parallel global-relation and local-spatial modeling. The resulting representations exhibit different information tendencies and promote partial functional decoupling between identity-related and modality-related information. Finally, the Decoupled Information-Guided Cross-Modal Alignment (DIG-CMA) module refines the two streams with channel and spatial attention and integrates them through cross-attention. Under the joint optimization objective, the resulting representations support cross-modal alignment. Experiments on SYSU-MM01, RegDB, and LLCM show that DIGCA achieves competitive overall performance compared with recent VI-ReID methods, providing empirical support for the effectiveness of the proposed decoupling-guided alignment strategy in cross-modal identity matching.

Qing-Song Deng, Guangqian Kong, Xun Duan et al. · 0 citations
Jul 2026

Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation

Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at https://github.com/zw-absin/DSGM upon acceptance.

Weixiang Zhou, Xingguo Xu, Yuhao Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.