Skip to content
Open access

An Adaptive Polyline-Path Mask Attention for Hyperspectral and Multispectral Image Fusion

Aug 2026 · Remote Sensing · Vol 18, pp. 2536 · 0 citations · 75 references

TL;DR

An Adaptive Polyline Path Masked Attention Network (AdaPPMA-Net) is proposed for HSI-MSI fusion and extensive experiments demonstrate that AdaPPMA-Net consistently outperforms several state-of-the-art methods across multiple quantitative metrics.

Abstract

Reconstructing high-resolution hyperspectral images (HR-HSIs) from low-resolution hyperspectral images (LR-HSIs) and high-resolution multispectral images (HR-MSIs) is an important multimodal remote sensing task for applications requiring both fine spatial details and reliable spectral characterization. However, existing Transformer-based HSI–MSI fusion methods still face difficulty in jointly preserving geometric structures and spectral continuity. Specifically, flattening two-dimensional image structures into one-dimensional token sequences tends to weaken local spatial connectivity, while standard self-attention does not explicitly model inter-band dependency, which may lead to structural distortion and spectral inconsistency in the fused results. To address these issues, this paper proposes an Adaptive Polyline Path Masked Attention Network (AdaPPMA-Net) for HSI-MSI fusion. First, an Adaptive Polyline Path Masked Attention mechanism is developed to explicitly encode horizontal and vertical geometric continuity, while a gating strategy is introduced to adaptively regulate positional constraints and suppress redundant dependencies. Second, a spectral enhancement module is embedded into the Transformer block to strengthen inter-band dependency modeling and alleviate the loss of spectral continuity during token interaction. Third, a spatial–spectral refinement (SSRefine) module is designed to recalibrate fused spatial–spectral representations, thereby improving reconstruction quality in the decoding stage. Extensive experiments on four public datasets demonstrate that AdaPPMA-Net consistently outperforms several state-of-the-art methods across multiple quantitative metrics. In particular, on the Washington DC Mall dataset, the proposed method raises PSNR by 4.2975 dB and lowers RMSE, ERGAS, and SAM by 39.03%, 39.35%, and 38.02%, respectively, compared with the strongest competing method. These results indicate that AdaPPMA-Net provides a more effective solution for high-fidelity multimodal remote sensing fusion.

Read PDF

Similar papers

Preprint Sep 2026

Learning Spatial-Spectral Refinement and Calibrating Complementary Observations for Hyperspectral Image Super-Resolution

This work proposes Two-Stage Reconstruction with Implicit Tensor Neural Representation (TSR-ITNR), a unified self-supervised framework integrating representation refinement and observation-guided calibration that demonstrates strong quantitative, visual, and spectral reconstruction performance without ground-truth HR-H...

Li-Qian Yang, Xing-Chi Chen, Xin-Feng Gui et al. · 0 citations
Open access Sep 2026

Unsupervised Scale-Conditioned Hyperspectral and Multispectral Image Fusion via a Frequency–Spatial Dual-Domain Network

Hyperspectral–multispectral image fusion reconstructs high-spatial-resolution hyperspectral images (HR-HSIs) by combining low-resolution hyperspectral images (LR-HSIs) with high-resolution multispectral images (HR-MSIs). Many methods only support integer resolution ratios; when the LR-HSI/HR-MSI ratio is fractional, in...

P. Tang, Ke Zheng, Jia-Xin Li et al. · 0 citations
Open access 2026

Band-Selected Spectral-Spatial Transformer With Temporal Adaptive Modulation for Hyperspectral Image Change Detection

Deep learning-based hyperspectral image (HSI) change detection (HSI-CD) methods have achieved promising accuracy. However, HSIs contain hundreds of highly correlated bands, while existing models often encode all bands with equal priority, resulting in redundant spectral computation. At the same time, bi-temporal featur...

Yan-Heng Wang, Kai Qin, Zhuan-Feng Li et al. · 0 citations
Sep 2026

Position-Aware Dual-Domain Hybrid Transformer for Single Hyperspectral Image Super-Resolution

A Position-Aware Attention Module (PAM) that employs MLP-based positional encoding to inject spatial structure information, thereby strengthening positional representation and a Query Interaction Mechanism (QIM) to enable complementary fusion of cross-domain features, where outputs of spatial and spectral branches serv...

Hai-Jun Wang, Hao-Yu Hu, Ya-Lin Nie et al. · 0 citations
Sep 2026

FK-Net: Frequency-Aware and Kernelizable Mamba-Transformer for Multispectral and Hyperspectral Image Fusion.

The proposed FK-Net effectively integrates the complementary spatial-spectral information from both modalities while preserving their inherent uniqueness, enabling the generation of more natural high-resolution images without significantly increasing computational complexity.

Ming-Jin Zhang, Zhong Yang, Jie Guo et al. · 0 citations
2026

ASSCA-Net: An Adaptive Spectral–Spatial Cooperative Attention Network for Hyperspectral Image Classification

Hyperspectral images (HSIs) possess fine spectral resolution. They can capture continuous and detailed spectral curves of ground objects, providing rich information for accurate classification. However, real-world scenes commonly suffer from diverse ground object morphology, spectral variability, and insufficient spati...

Shu-Fang Xu, Wei-Wen Xu, Shu-Yu Fei et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.