- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes Functional Prox, a continual learning method for spiking neural networks. The authors identify that existing gradient-based importance estimation methods are sensitive to the choice of surrogate gradients, which may lead to unreliable parameter protection. To address this issue, the proposed method estimates channel importance using JS divergence through forward interventions and applies layer-wise sparse protection with proximal updates to mitigate catastrophic forgetting.
Critical strengths
1.The paper addresses an important problem in continual learning for SNNs. The observation that different surrogate gradients can produce inconsistent importance estimates is interesting and provides a reasonable motivation for the proposed method. 2.The proposed forward-only importance estimation is intuitive and avoids dependence on surrogate gradients when evaluating a fixed network. The combination with proximal updates provides a reasonable approach to protecting previously learned knowledge.
Critical weaknesses
1.The paper is difficult to follow. In the Related Work section, the authors divide the discussion into two parts, but both parts mainly list existing studies without sufficient analysis. The connections between these studies and the proposed method are not clearly explained. The authors should better discuss how their work differs from and improves upon existing approaches. 2.In the Method section, the authors introduce several components and mathematical formulations without clearly explaining the motivation behind each component, the purpose of each equation, or how these components are connected. The overall presentation and organization of the method need significant improvement. 3.Could the authors compare JS-divergence-based importance with simpler methods, such as firing-rate-based importance and random channel selection, to better demonstrate its effectiveness? 4.The experiments are limited to conventional image datasets. More experiments on event-based datasets would help validate the proposed method. 5.Overall, the writing of the paper should be improved. Humans should review AI-generated content to ensure that it is logical and coherent.
Questions for authors
See weaknesses