Sep 2026· International Conference on Parallel Processing· 0 citations· 35 references
Computer Science
TL;DR
The Temporal Hadamard Transformer is proposed, a spiking model co-designed with hardware for in-memory edge vision that integrates sparse algorithms with parallel hardware execution, providing a practical path toward real-time edge systems under realistic resource constraints and physical device non-idealities.
Abstract
Reliable, ultra-low-power neuromorphic vision on edge devices requires attention mechanisms that combine accuracy with parallel, memory-efficient execution. Current Spiking Transformers suit neuromorphic data but retain the \(\mathcal {O}(N^2D)\) complexity of standard self-attention and weak temporal modeling, limiting their efficiency on in-memory edge hardware. We propose the Temporal Hadamard Transformer (THT), a spiking model co-designed with hardware for in-memory edge vision. Its Temporal Hadamard Attention (THA) combines a lightweight Temporal Processing Unit (TPU) for short-term temporal fusion with a binary Mask&Add operator. By replacing Query–Key–Value computation with accumulate-and-fire logic that maps efficiently onto memristor crossbars, THA reduces attention complexity to \(\mathcal {O}(ND)\) and enables highly parallel in-memory execution. On CIFAR10-DVS, THT achieves a peak Accuracy-to-Energy ratio of 157.06. THT consumes 0.51–2.19 mJ per inference. Its lowest-energy configuration uses up to 16 × lower energy than the compared models, while the largest configuration reaches 81.8% accuracy. We further design a detailed hardware deployment scheme and evaluate its robustness through non-ideal memristor crossbar simulations. Accounting for conductance drift and IR drop, the simulated deployment maintains 81.1% accuracy. Thus, THT integrates sparse algorithms with parallel hardware execution, providing a practical path toward real-time edge systems under realistic resource constraints and physical device non-idealities.
While Spiking Neural Networks (SNNs) offer a promising path toward energy-efficient edge intelligence, conventional Binary representations often suffer from high inference latency and discretization errors. Multi-level (graded) spike models address these limitations by increasing information density per pulse, yet they...
Wen-Fei Song, A. Castagnetti, Pierre-Emmanuel Novac et al.· Neuromorphic Computing and E...· 0 citations
The proposed MorphAtt is a novel digital accelerator that expedites SViT inference through streamlined processing and offers better performance and efficiency trade-offs than state-of-the-art, thereby enabling highly energy-efficient vision-based AI systems at the edge.
Spiking neural networks (SNNs) are progressively utilized for edge intelligence due to their replacement of dense multiply-accumulate (MAC) operations with sparse, eventdriven dynamics that are compatible with low-power hardware. Nonetheless, converting these benefits into effective item recognition and classification...
Aman Kumar, Nagendra Kumar, Manas Bajpai et al.· International Symposium on V...· 0 citations
This review first explains the signal path of an SNN chip through four connected modules: spike encoding, neuron computation, synaptic learning, and output decoding, and compares three implementation routes: digital many-core platforms, mixed-signal or sensor-integrated platforms, and memristive in-memory hardware.
Le-Yang Qin· Applied and Computational En...· 0 citations
This survey reviews 71 studies published between 2015 and 2025 and organizes them into a taxonomy that classifies GPU works into simulation frameworks, training-acceleration techniques, large-scale and multi-GPU simulation, and application deployments, and RISC-V works into instruction-set extensions and tightly-couple...
Edris Zaman Farsa, Amirhossein Ilkhani, Marc Reichenbach et al.· Neuromorphic Computing and E...· 0 citations
Deep spiking neural networks (SNNs) have gained significant attention in the current landscape of neural computing, primarily due to their remarkable energy efficiency and capability to perform complex computational tasks. This article presents the hardware implementation of a residual SNN (RSNN) architecture featuring...
Saras Mani Mishra, Souraja Kundu, Naorem Yaipharenba Meitei et al.· IEEE Transactions on Very La...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.