2026· IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing· Vol 19, pp. 30777-30794· 0 citations· 40 references
TL;DR
A spiking grouped separable convolutional vision transformer (Spiking-GSCViT) featuring a novel membrane-potential-aware grouped self-attention (MPA-GSA) module that mitigates the data-hungry nature of both ViTs and SNNs, enabling accurate and energy-efficient HSIC under limited supervision.
Abstract
Vision Transformers (ViTs) achieve high accuracy in hyperspectral image classification (HSIC) yet incur prohibitive computational cost, hindering edge deployment. Spiking neural networks (SNNs) promise energy-efficient event-driven computation, but directly transferring ViTs to SNNs leads to severe information loss from binary spikes, which is further amplified under the extremely limited labeled samples typical of HSIC. To address these intertwined challenges, we propose a spiking grouped separable convolutional vision transformer (Spiking-GSCViT) featuring a novel membrane-potential-aware grouped self-attention (MPA-GSA) module. MPA-GSA calculates attention weights from continuous, differentiable membrane potentials, rather than from lossy binary spikes. Moreover, leveraging the time-varying nature of membrane potentials, this novel attention mechanism is able to attend to different spectral–spatial regions across multiple time steps, thereby preserving rich discriminative features. Extensive experiments on four benchmark datasets with only 1% to 5% of the labeled samples per class show that Spiking-GSCViT matches or surpasses its ANN counterpart (94.16% on Indian pines and 97.71% on Salinas), with only 0.21 M parameters. The consecutive MAC operations are reduced by 81%, and the spike-driven synaptic operations (SOPs) are decreased by 39.2%. As a lightweight SNN-ViT hybrid architecture, Spiking-GSCViT simultaneously mitigates the data-hungry nature of both ViTs and SNNs, enabling accurate and energy-efficient HSIC under limited supervision.
Methods based on deep learning have achieved remarkable success in hyperspectral image change detection (HSI-CD). However, the high dependence on massive labeled data and the computational complexity of state-of-the-art models pose significant challenges, particularly in scenarios with extreme label scarcity. To addres...
Zhi-Yuan Zhang, Zhi-Jing Ye, Cheng-Yong Zheng et al.· IEEE Transactions on Geoscie...· 0 citations
SpikeYOLO-C2TCA, an improved SNN detector built upon the SpikeYOLO backbone, delivers better detection accuracy than the baseline while consuming less energy, offering a practical lightweight solution for edge platforms such as on-orbit satellites and long-endurance unmanned aerial vehicles.
Unknown authors· Journal of Superintelligence...· 0 citations
A new method for HSI classification by integrating spectral band selection with advanced deep learning techniques is presented, and an optimized band selection method alongside data augmentation using crop-and-resize transformations to enhance feature diversity is proposed.
Eman N. Abdelhafez, Ahmed Hagag, Tamer A. Abassy· Scientific Reports· 0 citations
Hyperspectral imaging (HSI) integrates spatial and spectral analysis for nondestructive food quality monitoring. While the integration of artificial intelligence (AI) has significantly advanced HSI analytics, prior reviews have predominantly focused on static, postharvest quality grading. This leaves a critical gap r...
Xiao-Wei Huang, Bao-Ze Liu, Xiao-Dong Zhai et al.· Journal of food process engi...· 0 citations
Accurate and computationally efficient plant disease detection is essential for scalable precision agriculture systems. While convolutional neural networks (CNNs) have achieved strong performance in crop disease classification, their localized receptive fields may limit modeling of long-range spatial dependencies in co...
Shahrin Khan, Sadia Sharmin, Labib Ahmed Leo et al.· IEEE Access· 0 citations
Hyperspectral imagery enables simultaneous estimation of categorical and continuous forest variables, yet most deep learning approaches address these tasks in isolation and rely on heavy single-branch encoders. We propose CroSpec-MT, a compact multitask network that learns from hyperspectral patches via three parallel,...
B. Amelsha, Akshara Preethy Byju· IEEE Geoscience and Remote S...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.