SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts

Excerpt

arXiv:2610.01418v1 Announce Type: new Abstract: Spiking Neural Networks (SNNs) enable event-driven computation through biologically inspired dynamics at the neuronal scale, while Mixture-of-Experts (MoE) perform conditional computation through expert selection at the model scale. Integrating their strengths offers potential for flexible neural architectures. A key challenge, however, lies in designing an expert selection mechanism based on spiking activity. To address this, we introduce a spike-