William Fishell

Feedforward spiking neural networks are not transformers (yet): a learning-theoretic framework for long-range dependencies and biological efficiency

Spiking neural networks offer a promising route toward low-power sequence computation on neuromorphic hardware, but they continue to lag behind attention-based artificial neural networks on long-context tasks. A central open question is whether this gap reflects only implementation and optimization limitations, or whet...