SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts
Spiking Neural Networks (SNNs) enable event-driven computation through biologically inspired dynamics at the neuronal scale, while Mixture-of-Experts (MoE) perform conditional computation through expert selection at the model scale. Integrating their strengths offers potential for flexible neural architectures. A key c...
Xiao-Li Liu, Yu Liang, Jia-Lin Li et al.
· 0 citations