Skip to content
Open access

TriFusion: A Unified CNN-Transformer Framework for Multiscale and Spectral-Spatial Learning in Hyperspectral Image Classification

2026 · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · Vol 19, pp. 35755-35772 · 0 citations · 63 references

TL;DR

The proposed TriFusion framework consistently achieves the best overall accuracy among recent CNN-based, Transformer-based, and hybrid methods, with gains of 0.26–1.42 percentage points over the strongest competing baseline across the four datasets.

Abstract

Hyperspectral image (HSI) classification remains challenging due to two fundamental issues: first, severe spectral redundancy and mixed spectral–spatial noise that degrade discriminability, and second, the difficulty of simultaneously capturing fine-grained local patterns and long-range contextual dependencies under limited labeled data.Existing convolutional neural network (CNN)-based methods excel at local feature extraction but fail to model global interactions, while Transformer-based models provide strong global modeling but are data-hungry and often overlook local spectral–spatial cues. To address these problems, we propose TriFusion, a unified CNN–Transformer hybrid framework that systematically integrates multiscale and spectral–spatial learning within a coherent fusion architecture. Specifically, an efficient spectral–spatial convolutional block is introduced to disentangle and enhance local spectral–spatial features while suppressing redundancy. A multiscale context module is further employed to aggregate contextual information. In addition, a deep feature pyramid progressively fuses hierarchical representations to preserve discriminative spectral–spatial semantics across scales. A lightweight Transformer encoder is finally incorporated to capture long-range dependencies. Extensive experiments on four widely used benchmarks (Pavia University, Salinas, WHU-Hi-Longkou, and Xuzhou) demonstrate that the proposed TriFusion framework consistently achieves the best overall accuracy among recent CNN-based, Transformer-based, and hybrid methods, with gains of 0.26–1.42 percentage points over the strongest competing baseline across the four datasets. Ablation studies and efficiency analyses further validate the effectiveness of each fusion component and the practical efficiency of the proposed design.

Read PDF

Similar papers

Open access 2026

MS2FTNet: Multiscale Spatial–Spectral Fusion Transformer Network for Hyperspectral Image Classification

Hyperspectral image classification (HSIC) aims to discriminate land cover categories accurately by exploiting rich spatial and spectral information. However, existing methods still suffer from insufficient collaborative modeling of spatial and spectral features, as well as inadequate fusion of local and global informat...

Jia-Qi Liang, Hai-Xin Sun, Fan-Lei Meng et al. · 0 citations
Open access Oct 2026

Dual-Branch Spatial–Spectral Transformer with Spatial Feature Enhancement for Hyperspectral Image Classification

Hyperspectral image classification is an important research topic in the field of remote sensing. Its core objective is to accurately identify different land-cover categories by jointly exploiting the spatial information and spectral characteristics of pixels. However, the complex and diverse spatial structures of grou...

Li-Guo Wang, Teng Wen, Dan-Feng Liu · 0 citations
Open access Oct 2026

Spatial contextual learning for hyperspectral imagery classification using transformer encoder framework based ensemble model

This work proposes a four–stage hybrid framework for hyperspectral image classification that integrates spectral modeling and spatial feature extraction within a unified pipeline and compares the model with recent baselines, including DaViT.

Disha Goyal, Rashi Mishra, Mohit Somani et al. · 0 citations
Open access 2026

LGCF-Net: Local–Global Cross-Modal Fusion With Residual-Gated Attention for Hyperspectral–LiDAR Land-Cover Classification

A local–global cross-modal fusion network (LGCF-Net), a hybrid fusion framework that explicitly models local–global feature interactions for HSI–LiDAR classification and achieves the best overall accuracy on MUUFL, Trento, and Augsburg, while attaining the highest average accuracy and Kappa on Houston.

M. Z. ur Rehman, S. Islam, Anwaar Ulhaq et al. · 0 citations
Open access Sep 2026

LMCAN: A Lightweight Multiscale Contextual Attention Network for Hyperspectral and Multispectral Image Fusion

A Lightweight Multiscale Contextual Attention Network (LMCAN) is proposed that reconstructs spatial context without altering the pixel-level representation, enabling information at different scales to interact adaptively rather than being modeled in isolation.

Ming-Ming Ma, Zheng-Zhong Fang, Pei-Xian He et al. · 0 citations
Oct 2026

Single Hyperspectral Image Super-Resolution Using Multi-scale Cross-spectral Transformer Network

Hyperspectral image super-resolution seeks to produce images with finer spatial detail while keeping spectral information consistent, which supports more reliable analysis in hyperspectral imaging applications. However, existing methods mainly rely on 2D/3D convolutions, which are limited to modeling local spatial-spec...

Hai-Jun Wang, Yao-Wei Wang, Ya-Lin Nie et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.