Sep 2026· IEEE Transactions on Pattern Analysis and Machine Intelligence· Vol PP· 0 citations
Medicine
TL;DR
A novel Phase Updating and Transform Network (PUTNet) is developed, which performs two key operations including updating the saliency phase component under RGB-D-Saliency phase consistency constraints, and generating the final saliency map through global phase-to-image transform.
Abstract
For RGB-D salient object detection (SOD), a fundamental challenge lies in establishing effective cross-modality interactions between the input graphic domain (RGB and depth modalities) and the output saliency domain. While existing deep learning methods primarily focus on modeling image-level consistency through carefully designed feature extraction and fusion modules, this paper reveals a crucial discovery: the discrepancy in the phase component between the graphic and saliency domains can be reasonably approximated by a Laplacian distribution. Inspired by this observation, we establish a RGB-D-Saliency phase consistency model for RGB-D SOD, which explicitly formulates the cross-modality relationship from a phase perspective. Building upon this model, we develop a novel Phase Updating and Transform Network (PUTNet). It performs two key operations including (a) updating the saliency phase component under RGB-D-Saliency phase consistency constraints, and (b) generating the final saliency map through global phase-to-image transform. Extensive experiments across nine different RGB-D SOD datasets demonstrate that PUTNet outperforms state-of-the-art methods in both quantitative and qualitative evaluations.
A depth-aware framework (LDANet) for RGB-D SOD, which consists of a dual-branch encoder and four elaborately designed collaborative modules for progressive feature optimization, to strengthen multi-modal dependencies and capture multi-scale contextual information.
Bao-Yu Wang, Ping-Ping Cao, Xiao-Chun Guo et al.· Journal of King Saud Univers...· 0 citations
A Multi-modal Interaction Enhanced Segment Anything Model (MIE-SAM) that reconfigures SAM's image encoder into a weight-sharing dual-branch image encoders, and translates the fused features into the fine-grained saliency map in an entirely prompt-free, end-to-end manner.
Ze Li, Ying-Ying Zhang, Shuai Zhang et al.· Neural Networks· 0 citations
A Boundary-Guided Dual-Perspective Cross-Modal Fusion Network (BDPNet) is proposed to explicitly preserve shallow geometric structures and decouple deep semantic fusion into macroscopic and microscopic perspectives.
Hu Lin, Zhi-Wei Fu, Xiu-Mei Chen et al.· Remote Sensing· 0 citations
A novel multi-modal segmentation framework based on a cross-attention mechanism was presented that enables more effective interaction between RGB and depth features and shows consistent improvements in segmentation accuracy, particularly in challenging scenarios.
Noor Safa, Zainab Majeed Abid· Academic Journal of Electric...· 0 citations
Method is proposed, a reliability-aware geometry distillation framework developed for RGB-D SOD benchmarks without using dataset-provided depth during training or inference, and achieves the best or tied-best result in 26 of 36 metric-dataset comparisons against ten recent RGB-D SOD methods.
Xue-Hao Wang, Jia-Xin Hua, Run-Mei Li et al.· 0 citations
RGB-D semantic segmentation has made notable progress by fusing RGB and Depth, yet mainstream models still learn features almost exclusively from pixel-level supervision, lacking direct high-level semantic constraints. This raises a central question-can external knowledge such as language priors inject stronger semanti...
Zi-Chuan Wei, Yin-Long Liu, Yan Xia et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.