Aug 2026· Remote Sensing· Vol 18, pp. 2536· 0 citations· 75 references
TL;DR
An Adaptive Polyline Path Masked Attention Network (AdaPPMA-Net) is proposed for HSI-MSI fusion and extensive experiments demonstrate that AdaPPMA-Net consistently outperforms several state-of-the-art methods across multiple quantitative metrics.
Abstract
Reconstructing high-resolution hyperspectral images (HR-HSIs) from low-resolution hyperspectral images (LR-HSIs) and high-resolution multispectral images (HR-MSIs) is an important multimodal remote sensing task for applications requiring both fine spatial details and reliable spectral characterization. However, existing Transformer-based HSI–MSI fusion methods still face difficulty in jointly preserving geometric structures and spectral continuity. Specifically, flattening two-dimensional image structures into one-dimensional token sequences tends to weaken local spatial connectivity, while standard self-attention does not explicitly model inter-band dependency, which may lead to structural distortion and spectral inconsistency in the fused results. To address these issues, this paper proposes an Adaptive Polyline Path Masked Attention Network (AdaPPMA-Net) for HSI-MSI fusion. First, an Adaptive Polyline Path Masked Attention mechanism is developed to explicitly encode horizontal and vertical geometric continuity, while a gating strategy is introduced to adaptively regulate positional constraints and suppress redundant dependencies. Second, a spectral enhancement module is embedded into the Transformer block to strengthen inter-band dependency modeling and alleviate the loss of spectral continuity during token interaction. Third, a spatial–spectral refinement (SSRefine) module is designed to recalibrate fused spatial–spectral representations, thereby improving reconstruction quality in the decoding stage. Extensive experiments on four public datasets demonstrate that AdaPPMA-Net consistently outperforms several state-of-the-art methods across multiple quantitative metrics. In particular, on the Washington DC Mall dataset, the proposed method raises PSNR by 4.2975 dB and lowers RMSE, ERGAS, and SAM by 39.03%, 39.35%, and 38.02%, respectively, compared with the strongest competing method. These results indicate that AdaPPMA-Net provides a more effective solution for high-fidelity multimodal remote sensing fusion.
This work proposes Two-Stage Reconstruction with Implicit Tensor Neural Representation (TSR-ITNR), a unified self-supervised framework integrating representation refinement and observation-guided calibration that demonstrates strong quantitative, visual, and spectral reconstruction performance without ground-truth HR-H...
Li-Qian Yang, Xing-Chi Chen, Xin-Feng Gui et al.· 0 citations
Hyperspectral–multispectral image fusion reconstructs high-spatial-resolution hyperspectral images (HR-HSIs) by combining low-resolution hyperspectral images (LR-HSIs) with high-resolution multispectral images (HR-MSIs). Many methods only support integer resolution ratios; when the LR-HSI/HR-MSI ratio is fractional, in...
P. Tang, Ke Zheng, Jia-Xin Li et al.· Remote Sensing· 0 citations
Deep learning-based hyperspectral image (HSI) change detection (HSI-CD) methods have achieved promising accuracy. However, HSIs contain hundreds of highly correlated bands, while existing models often encode all bands with equal priority, resulting in redundant spectral computation. At the same time, bi-temporal featur...
Yan-Heng Wang, Kai Qin, Zhuan-Feng Li et al.· IEEE Journal of Selected Top...· 0 citations
A Position-Aware Attention Module (PAM) that employs MLP-based positional encoding to inject spatial structure information, thereby strengthening positional representation and a Query Interaction Mechanism (QIM) to enable complementary fusion of cross-domain features, where outputs of spatial and spectral branches serv...
Hai-Jun Wang, Hao-Yu Hu, Ya-Lin Nie et al.· International journal of pat...· 0 citations
The proposed FK-Net effectively integrates the complementary spatial-spectral information from both modalities while preserving their inherent uniqueness, enabling the generation of more natural high-resolution images without significantly increasing computational complexity.
Ming-Jin Zhang, Zhong Yang, Jie Guo et al.· IEEE Transactions on Cyberne...· 0 citations
Hyperspectral images (HSIs) possess fine spectral resolution. They can capture continuous and detailed spectral curves of ground objects, providing rich information for accurate classification. However, real-world scenes commonly suffer from diverse ground object morphology, spectral variability, and insufficient spati...
Shu-Fang Xu, Wei-Wen Xu, Shu-Yu Fei et al.· IEEE Transactions on Geoscie...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.