- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper aims to reduce the cost of online training for spiking neural networks. The method maintains incrementally updated activity traces and replaces continuous error signals with sparse signed ternary events, allowing parts of error propagation and weight updates to use additions and subtractions without storing the full temporal sequence. The authors apply the method to CNNs, Transformers, LSTMs, and Mamba models, evaluate accuracy and estimated computational energy on DVS-Gesture and SHD, and analyze the effects of error encoding precision and network depth. The main contribution is an event-based learning rule and its adaptation to different network architectures.
Critical strengths
The paper addresses the practically relevant problem of SNN training efficiency. It evaluates the method across several architectures and demonstrates a reasonably competitive trade-off between accuracy and estimated computational cost on CNNs, providing useful empirical results for event-based online learning.
Critical weaknesses
-
The incremental contribution is unclear. Positive and negative error events have precedents; the main additions are architecture adaptation, a layer-averaged surrogate derivative, and multiple-timescale traces. Please identify which changes are essential for deep learning and demonstrate their value through comparisons with closely related methods using the same architecture.
-
The effects of key components are not isolated. The error-alphabet and depth studies are useful, but do not establish the individual contributions of the averaged surrogate derivative, multiple-timescale traces, and event control. Please provide key ablations to distinguish benefits of the new mechanisms from those of sparsification, quantization, or training changes.
-
Performance and applicability are limited. The stochastic CNN variant is 2.22 percentage points below OSTL in the same group, while the Transformer is approximately 12 points below strong baselines. Absolute SHD accuracies are also low across methods. Although the authors acknowledge this limitation, practical competitiveness on challenging temporal tasks remains unestablished.
-
Widening confounds the depth analysis with increased capacity. Widening increases parameters, capacity, and computation, so recovered accuracy cannot be attributed solely to the error channel. Please provide baselines with the same width or matched parameter/computational budgets to test depth-scaling and efficiency advantages under comparable resources.
-
Ternary optimality lacks controlled evidence. The study covers a single CNN, and stochastic versus deterministic encoding is not clearly held consistent across alphabet sizes. Please fix other key conditions to separate encoding precision from sampling and event-budget effects, and limit the conclusion if it only applies to this setting.
Questions for authors
Please see the weaknesses above.