HazeSpikeMamba is proposed, a compact dehazing framework that combines a spiking-inspired local path and an attentive state-space global path in a multi-scale U-Net that consistently improves BRISQUE and NIMA on RTTS, URHI, and HSTS.
Abstract
Dehazing networks are commonly trained on synthetic hazy-clear pairs, but their performance often drops on real photographs. Synthetic haze generated using the atmospheric scattering model does not fully capture the variability of real haze, and paired real hazy-clear images are scarce. In this work, we propose HazeSpikeMamba, a compact dehazing framework that combines a spiking-inspired local path and an attentive state-space global path in a multi-scale U-Net. The local path uses TPCNNSpike, a new spike-emission scheme inspired by the neighborhood coupling of Pulse-Coupled Neural Network (PCNN). Unlike grouped directional scanning, TPCNNSpike updates all neurons in parallel using the previous firing states of their Gaussian-weighted neighborhoods. The global path adapts the Attentive State-Space Module of MambaIRv2, retaining semantic prompting and sequence reordering while removing the window self-attention branch. Its state-space processing models long-range dependencies with complexity linear in sequence length. For target-domain adaptation, a frozen degradation network, pretrained on paired NH-HAZE data, re-synthesizes haze from the dehazed prediction. The reconstruction error updates only the final restoration layers of HazeSpikeMamba without haze-free labels during adaptation. A shared checkpoint is adapted once on each complete unlabeled target set, making the evaluation dataset-level and transductive rather than zero-shot or per-image optimization. The forward network contains 2.02M active parameters and requires 13.27G nominal MACs (measured with thop at 256x256 input). This adaptation consistently improves BRISQUE and NIMA on RTTS, URHI, and HSTS. On RTTS, BRISQUE decreases from 30.13 to 27.72 and NIMA increases from 4.13 to 4.87. Under this transductive protocol, the adapted model also achieves the best BRISQUE and NIMA on URHI and HSTS among the compared methods.
This work pioneers the synergistic integration of SNNs into Transformer architectures for LLIE, establishing a compelling pathway toward powerful, energy-efficient low-level vision on resource-constrained platforms.
Hongzhi Wang, Xiubo Liang, Jinxing Han et al.· Advances in Neural Informati...· 0 citations
A predictive model receives a self-supervised signal whenever the consequence of an action is observed. Using that signal after deployment is difficult when dynamics and semantics share parameters: freezing prevents adaptation, whereas weight updates require optimizer state and may alter the learned representation. Here we introduce SpikeWorld, a 1.45M-parameter sparse spiking model jointly trained for heterogeneous sensory prediction, semantics, image-text binding and action-conditioned dynamics. At deployment, all trained parameters are frozen. Delayed next-state residuals update two external paths: cumulative fixed-bank losses select the bounded action correction, while route-specific residual matrices refine next-state prediction. Neither path uses labels, teacher outputs, rewards, success signals or the true shift value. Joint optimization improves action next-state MSE by 17.10\% while also improving multimodal prediction, semantic accuracy and image-text retrieval. On held-out shear and attenuation streams, the combined external state improves aggregate prediction by 5.48\% and 30.01\%; its fixed-bank action path improves tracking by 24.20\% and 3.94\%, respectively. In a six-arm study comprising 450 new Meta-World trajectories (75 per arm), SpikeWorld raises frozen-policy reward by 7.90 (95\% CI [2.48, 14.06]); the 13.33-point success difference is descriptive (CI [0, 40]). For identical sensory inputs, model parameters and inherited semantic outputs remain bitwise unchanged. A 16-byte RLS estimator obtains the highest non-oracle reward on linear attenuation, showing that the contribution is not superior linear identification, but its integration with a frozen multimodal spiking checkpoint. Reference code is publicly available at https://github.com/Oooorca/SpikeWorld.
The haze effect induces light attenuation and color shifting in distant objects, thereby diminishing the contrast and saturation of images. In pursuit of restoring image clarity, a plethora of dehazing methods have been successively introduced. Nevertheless, the development of effective and practical methodologies remains a formidable challenge due to the requirement for powerful feature extraction capability alongside consideration of computational efficiency and model scalability. To address these issues, we put forward a boosted spiking neural network with retina mechanism, termed ReBo-SNN, for the reconstruction of hazy images. Specifically, the proposed network draws inspiration from the antagonistic mechanisms of retinal neurons and innovatively devises a retinal module. By extracting highly expressive features through ON and OFF roads, the retinal module can effectively augment visual resolution and contrast. Furthermore, to circumvent the issue of excessive smoothing, the network introduces a novel boosting strategy that realizes progressive feature enhancement and assists in reconstructing high-quality dehazed images. In addition, the network also incorporates dense residual connections with strided convolution to compensate for potential information loss during the translation, which significantly enhances the efficiency of feature transmission and integration. Extensive experiments on both synthetic and real-world hazy images demonstrate that our proposed network achieves superior quantitative and qualitative results. Based on the spiking mechanism and compact architecture, our network also exhibits a substantial energy efficiency advantage, which promotes its deployment in vision hardware to enhance overall performance.
Ya Zhang, Zhitong Zhao, Qian Sun et al.· Neural Networks· 0 citations
This work introduces a Temporal Feedback Coding (TFC) scheme that leverages feedback at the encoding stage to diversify spike patterns and designs a Global-Local Dynamic LIF (GLD-LIF) neuron that enhances cross-step dependency modeling by integrating local aggregation and global initialization.
Experiments on HDRTV1K show that Bio-SFT achieves competitive perceptual quality and consistently improves HDR-VDP-3 and $\Delta E_{ITP}$ while reducing artifact propagation in symmetric guidance pipelines.
Tingyu Cheng, Ting Zhang, Chongyi Li et al.· 0 citations
Findings show the impact of inference stage design decisions in STDP-based SNN-VPR on recall precision, although the separate contribution of each mechanism and implementation differences is only partially disentangled and needs further examination.