A disentanglement method based on Mutual Information Minimization is introduced to minimize statistical dependence between modality-shared and modality-specific features from a probability distribution perspective and a Local Discriminative Attention Module is designed to adaptively focus on highly informative body parts such as head-shoulder ratio and torso patterns.
Abstract
Visible-Infrared Person Re-Identification (VI-ReID) is essential for all-weather surveillance in smart city applications. Existing methods still face two critical bottlenecks. First, significant modal discrepancies between visible and infrared images lead to serious distribution shifts, causing identity-irrelevant modality information to interfere with identity semantics. Second, decoupled shared features often lack focus on discriminative local regions, which limits the model's ability to capture fine-grained details. To address these issues, we propose a novel framework termed Modality Disentanglement and Local Discriminative Enhancement (MDLDE). We first introduce a disentanglement method based on Mutual Information Minimization to minimize statistical dependence between modality-shared and modality-specific features from a probability distribution perspective. Subsequently, a Local Discriminative Attention Module is designed to adaptively focus on highly informative body parts such as head-shoulder ratio and torso patterns. By reinforcing these localized cues, the model achieves robust fine-grained representations against complex backgrounds. Extensive experiments on the SYSU-MM01 datasets demonstrate the superiority of our method. On the SYSU-MM01 All-Search mode, we achieve 73.9% Rank-1 and 69.7% mAP, outperforming current state-of-the-art approaches.
This work proposes MDCRNet, a Multi-scale Decomposed Convolution Refinement Network that enhances cross-modal feature learning and discriminative metric learning, and develops a Joint Discriminative Metric Loss incorporating a novel Granularity Discriminative Loss (GDL).
Mingsheng Zheng, Zi-Rui Jiang, Bo Liu et al.· 0 citations
A Progressively Biased Split Vision Transformer (PBSVT) is proposed, which combines a split ViT backbone with progressive bias training to gradually reduce RGB-dominant bias while preserving modality-shared structure and demonstrates the effectiveness of progressive modality transition for robust VI-ReID representation...
Mengru Jiao, Xin-Yue Xu, Jun-Feng Zhang· International journal of pat...· 0 citations
A CLIP-Guided Progressive Body-Part Semantic Alignment Network is proposed, termed PBSA-Net, which introduces CLIP-derived textual semantics as modality-agnostic guidance for both global representation learning and local body-part feature extraction.
A Transformer-based baseline framework for visible-infrared ReID is proposed, designed to effectively capture modality-invariant features and outline several promising directions for future research.
Xiao Wang, Bing Wang, Bin Yang et al.· arXiv.org· 0 citations
DMFNet (Diverse Mid-feature Network) is presented, a novel deep learning architecture that effectively harnesses intermediate shared features to bridge this cross-modal gap and enhances cross-modal matching capabilities but also provides interpretable feature visualizations, offering valuable insights into the network'...
Structural-Semantic Reciprocal Learning (SSRL), a framework that transforms open-loop association into a self-correcting closed-loop system, achieves robust cross-modal representation through the reciprocal interaction between structural and semantic learning.
Moyao Tian, Shijia Liu, Yan Yang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.