- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes STAR (Spike-driven Task-Adaptive Resource allocation), a rehearsal-free method for continual learning in spiking neural networks. Built on the k-WTA SNN architecture, STAR introduces two mechanisms: Generate-and-Test and Sleep Consolidation. These mechanisms function by replacing low-utility neurons with mutated clones of high-utility neurons, and by preserving statistically selected expert neurons while resetting redundant ones, respectively. Experiments on Split-MNIST, CIFAR-100, and TinyImageNet report improvements in accuracy, memory retention, and neuron utilization.
Critical strengths
This paper proposes a well-motivated and clearly structured neuron-level resource management framework. It addresses two key issues in SNN continual learning: reclaiming under-utilized neurons and preserving important neurons. The paper also provides neurodynamic analyses to examine the behavior of the proposed method.
Critical weaknesses
- The paper uses cumulative spike counts as a measure of neuronal utility. Based on this criterion, high-utility neurons are treated as experts and frozen, whereas low-utility neurons are considered redundant and replaced. However, the paper lacks targeted ablation studies or direct analyses demonstrating whether spike utility truly reflects the functional importance of individual neurons.
- The experiments are not sufficient to fully establish STAR's competitiveness against recent SNN continual learning methods. Comparisons with several recent and closely related approaches are missing. Furthermore, on TinyImageNet, the reported results primarily compare STAR with the baseline, without a comprehensive comparison against other methods.
Questions for authors
- The paper states that the CIFAR-100 experiments use a frozen non-spiking CNN feature extractor, with continual learning performed on the resulting embeddings. What data were used to train this encoder? Did all comparison methods use exactly the same frozen encoder?
- The number of experts in the proposed method increases continuously. Does the method remain applicable for longer sequences of tasks?
- Although the paper claims the method is resource-efficient, it lacks empirical metrics to substantiate these claims.
- What is the rationale for the expert selection threshold, and how sensitive is the method to this choice?
- How is "neuron utilization" defined in the experimental results?