- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a novel Spiking Threshold Gating (STG) technique that bridges the gap between ANN activations and spiking neurons through different parameter configurations within a unified framework.
Critical strengths
-
The design of STG is novel, particularly in its ability to unify ANN activations and spiking neurons within a single framework.
-
The authors provide extensive theoretical analysis of the proposed STG framework, which helps establish the theoretical foundation of the proposed ANN–SNN continuum.
Critical weaknesses
-
Most of the main experimental results in Table 3 are obtained using graded or multi-bit quantized emissions rather than strictly binary spikes. Although graded emissions may improve gradient propagation and representational capacity, they differ substantially from conventional binary spiking neurons. Therefore, direct comparisons with SNNs using strictly 0–1 outputs may not be entirely fair, as the proposed models benefit from additional representational capacity.
-
Since the authors claim that "ANNs with typical activation functions and canonical spiking neurons become part of a differentiable continuum," experimental evidence is needed to validate this claim. However, the current experiments primarily compare the proposed method with SNNs trained using surrogate gradients, which does not directly demonstrate the effectiveness of the proposed ANN–SNN continuum. Comparisons with conventional ANN-to-SNN conversion methods would provide stronger support for this central claim.
Questions for authors
Please see the Weaknesses part.
3 comments
After Rebuttal
Thank you for the response. My concerns have been fully addressed. After carefully reading the rebuttal and the other reviewers' comments, I have decided to maintain my original rating.
Thanks
Thank you for reading our rebuttal and confirming that your questions were addressed
Response to the respected reviewer (kRAM)
We thank the reviewer for the positive assessment of the unification of ANN activations and spiking neurons and of the theoretical analysis. We answer the two weaknesses.
Graded and multi-bit emission against binary spikes. We agree that binary and graded emission should be compared separately. First, two of the comparisons in Table 3 (Section 6) are already strictly binary. On MSWC-FSCIL, the only change to the NeuroBench network is the neuron: STG replaces RadLIF and the emission stays binary, as with RadLIF. The accuracy rises from 75.27% to 83.32% (+8.05 points), and it is 83.54% with an exact Heaviside gate (Table 7, Section 6.4). On DVS-Gesture, the DTS-SNN row is also binary: 95.83% against 94.44% for the same network with LIF.
Second, where Table 3 uses graded emission, binary or graded output is a setting of the same cell, so we trained both on the same networks (Table 10, Appendix C, 3 seeds).
Binary emission costs 1.4 to 2.6 points against graded emission, which quantifies the additional capacity that the reviewer points to. The binary models are still above binary baselines: 94.32% against 87.37% for LIF in the same MS-ResNet-20, and 81.78% against 80.69% for DCLS-Delays on SSC. Finally, when the trained gate of a binary model is replaced by an exact Heaviside, the accuracy is kept (Table 7, Section 6.4), and the firing pattern shows that every channel sends either zero or one fixed value (Figure 3, Appendix C). Section 4 gives the reason (lines 260–262).
Evidence for the ANN–SNN continuum, and comparison with ANN-to-SNN conversion. We would like to clarify one point first. The submitted version already contains a direct demonstration of the continuum, beyond comparisons with surrogate-gradient SNNs: the CIFAR10-DVS model starts from an ImageNet-pretrained ANN (ConvNeXt-Small), its activations are replaced by STG cells, and the sharpness curriculum carries it to spiking emission (94.10 ± 0.17%, and 93.47 ± 0.32% with 4-bit emission; Section 6.1). We did not state this clearly enough. We now say it explicitly in the contributions (lines 78–79), in Section 3 (line 241) and in Section 6.1 (lines 382–384), and we added a curve of accuracy against sharpness for this model (Figure 4, Appendix C).
However, we agree that a comparison with ANN-to-SNN conversion strengthens this, and we added one with MST [36] (Table 4, Section 6.1). MST converts an ImageNet-pretrained ANN and reaches 88.12% on CIFAR10-DVS with T=512. It is not fully spiking, as its released code keeps a real-valued softmax in the attention (marked in Table 4). Yet STG is better: a ConvNeXt-Tiny of the same size (28M) reaches 91.23 ± 1.60% with T=16. From the same ImageNet weights, a standard LIF neuron trained with surrogate gradients reaches 87.30 ± 2.38% against 92.43 ± 0.81% for STG. So the continuum, and not only the backbone, carries the pretrained ANN into the spiking regime. The same holds at ImageNet scale: a pretrained ConvNeXt-Tiny with STG cells reaches 71.07% on I2E-ImageNet with 8-bit emission and an exact Heaviside gate, against 60.50% for the published MS-ResNet-34 with binary LIF trained from scratch [18] (Table 3, Section 6; details in Table 11, Appendix C).