- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper focuses on the hybrid training of Spiking Neural Networks (SNNs). The SNNs are initially obtained via conversion, and a unique bias is applied at each time step to mitigate what the authors term a "membrane-threshold mismatch." The authors provide an analysis of how this mitigation is achieved. Experimental results indicate that the proposed method enables the network to perform similarly during both early and late stages of the inference process.
Critical strengths
Strengths: Addressing the performance of SNNs in practical applications is an important endeavor. The opening figure effectively illustrates the potential application of SNNs in autonomous driving.
Critical weaknesses
Weaknesses: A compelling question—perhaps one the authors have not yet considered—is this: if a model can indeed perform well from the very first time step, why not simply use a binary or ternary neural network instead? Furthermore, if high performance is achieved within the first few time steps, what is the practical utility of the subsequent inference time? This is a fundamental question that should have been addressed during the initial design phase of the research.
Initially, based on the abstract, I assumed this was a paper about SNN conversion—a topic that would be quite significant, as it would obviate the need for post-conversion training. However, upon reading the full paper, I discovered it actually concerns "hybrid learning." Consequently, I believe the benchmarks used for comparison are either unfair or inadequately labeled.
A primary reason for my rejection recommendation: The paper states, "For the first time, we define and systematically analyze the 'membrane-threshold mismatch' in SNN inference systems, which hampers the usefulness of elastic inference." A quick query via a tool like Google AI (accessible to everyone) regarding whether the "membrane-threshold mismatch" in SNN inference has been analyzed yields an affirmative answer. I am curious as to why the authors chose to make this claim. I strongly advise removing phrases like "for the first time." Instead, clearly articulate the scope, objectives, and rationale of your work. This is far more valuable than dismissively ignoring the existing literature.
Questions for authors
Questions:
-
Regarding the abstract (line 28): You mention issues related to both conversion and direct training, then immediately transition to the "root cause of early-stage performance." Does this "root cause" refer to conversion, direct training, or both? Additionally, the text does not explicitly state that the "temporal bias" is trainable, which could be misleading to readers.
-
Is the component on the left side of Figure 1 the source ANN? Why does the SNN on the right exhibit higher performance? The relationship between ANN and SNN should be clarified in the figure. Furthermore, what is shown in the first row? Why does the SNN have bounding boxes (bboxes) while the one on the left does not? In the second row, why does the SNN on the right have bounding boxes but no numerical values, while the one on the left lacks bounding boxes entirely? This is quite confusing; I find it completely incomprehensible.
-
Lines 70–74: Regarding "early inference," there is an implicit assumption that has not been addressed: how is the decoding performed? This should be explicitly stated—especially since this paper is not solely focused on classification accuracy.
-
The authors employ the STBIF neuron model. On which hardware does this specific neuron model offer an advantage? Has this method been implemented on any actual hardware? Why did the authors choose this particular model? For a paper with an applied focus, it is essential to consider neuron models that are feasible for hardware implementation.
-
Lines 151–152: The paper you cite to prove equivalence is from arXiv and has not undergone peer review. For a paper intended for publication in a peer-reviewed venue, it is advisable to cite appropriate, peer-reviewed sources. It is not even clear from the citation where this paper is published—is it indeed on arXiv? The reference is: "Jing Yan, Kang You, Zhezhi He, and Yaoyu Zhang. 2026. Determinism in the undetermined: Deterministic output in charge-conserving continuous-time neuromorphic systems with temporal stochasticity."
-
Table 1 should include an additional column indicating that your method requires further training after the conversion process, so that readers are clearly aware of the associated costs.