- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an event action to predict the loss jump caused by the deletion of a spike in spiking neural networks. The method uses EventProp adjoints to combine the contributions of the membrane reset and downstream synaptic transmission. The authors evaluate the prediction on 120 spike deletions in a trained LIF network and report a Pearson correlation of 0.99995 between the predicted and measured loss jumps. They also show that the prediction improves the ranking of finite parameter updates. The problem is relevant to gradient-based learning in SNNs, although the theoretical basis and practical benefit of the proposed method remain unclear.
Critical strengths
-
The paper addresses an important problem in SNN learning, where finite parameter updates can change the spike sequence and cause loss changes that are not captured by local gradients.
-
The proposed approach keeps the original loss and neuron dynamics unchanged, which makes it an interesting alternative to existing methods based on loss shaping or modified dynamics.
-
The reported prediction accuracy is very high. In addition, the authors provide controls, an independently trained network, and an evaluation on examples from a held-out speaker.
-
The finite-update experiment provides initial evidence that predicting the deletion jump can improve the comparison of candidate parameter updates.
Critical weaknesses
-
The novelty is not sufficiently established. The event action is constructed from existing EventProp adjoint terms, and the paper does not clearly explain what is theoretically new beyond combining these terms to predict a finite loss change. In particular, it remains unclear whether the relationship follows from hybrid-system adjoint theory under specific assumptions or is only an empirical observation.
-
The measured loss jump is computed at two points around the deletion boundary, but the paper does not clearly report the boundary tolerance or demonstrate numerical convergence. Therefore, it is unclear whether the measurement isolates the discontinuous loss change from the continuous loss variation near the boundary.
-
The selection criterion checks changes in the hidden-layer spike-count matrix, but it does not clearly establish that no other discrete event changes contribute to the measured loss jump.
-
The evaluation is limited to a shallow feedforward network. The replication experiments use only 20 deletions each, and the finite-update analysis uses 20 directions. Moreover, the statistical analysis does not clearly account for dependencies between deletions from the same network and examples.
-
The practical relevance remains limited. The paper shows improved ranking of finite parameter updates, but does not demonstrate that incorporating the event action into training improves convergence, loss, or classification accuracy.
Questions for authors
1- Can the authors derive the relationship between the event action and the limiting loss jump, and clarify under which assumptions it is exact or approximate?
2- What boundary tolerance is used, and do the results remain stable when the boundary search and numerical simulation tolerances are varied?
3- How do the authors ensure that the measured loss jump is caused only by the target spike deletion, rather than by additional event changes?
4- How does the proposed method differ theoretically and practically from existing EventProp adjoint-based analyses and methods addressing spike creation and deletion?
5- Does incorporating the predicted jump into an actual training procedure improve learning compared with standard EventProp and existing approaches?