- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes an approach for ANN-to-SNN conversion using a shared calibration network. In this work, they first copy the weights of the ANN network to the SNN and freeze it, only the neuron parameters are calibrated using an MLP. For each optimisation step of the MLP, it receives channel-wise statistics of the ANN, the MLP then computes the neuron parameters for each channel and sets them in the SNN. SNN, with these neuron values and frozen weights, simulates the spiking dynamics. A loss is computed by comparing the features of ANN and SNN outputs, which is backpropagated to update the parameters of MLP.
Critical strengths
The major strength of this paper lies in its simplicity.
The empirical results shown in the paper are quite impressive.
Critical weaknesses
One of my major concerns is the absence of comparisons with direct SNN training methods, such as MS-ResNet, Spikeformer, and other recent direct training methods. In the ANN-to-SNN literature, it is quite common to compare performance with direct training methods. Since the proposed method performs well at low latency, I believe such comparisons are particularly important for evaluating its practical competitiveness.
Questions for authors
See the weaknesses section.
Dear Reviewer 6Q1L,
We sincerely apologize for the delay in our response. We know it shortens the time available for discussion, and we regret that. We spent the extra time collecting results for directly trained SNNs from their original papers and checking that each entry matches its stated architecture and number of time steps. We did not want to give you an inaccurate comparison. If there is still time in the discussion period, we would be grateful for any further questions or suggestions, and we will respond as quickly as we can.
Thank you for your careful reading and for your positive comments on the simplicity of StageCal and its empirical results. Our response to the main concern follows.
W1. Comparison with direct SNN training methods
We agree that this comparison is needed to judge how competitive the method is in practice, especially in the low-latency regime. Table R1 compares StageCal on ImageNet-1K with representative direct training methods. Our numbers come directly from Table 2 of the paper. Numbers for the other methods are taken from their original publications.
Table R1. ImageNet-1K top-1 accuracy (%).
† With a larger test resolution, MS-ResNet-104 reaches 76.02% (288×288) and SDT-8-768 reaches 77.07%.
At a matched parameter scale of about 21.8M and T = 4, StageCal reaches 68.62%. This is comparable to TET on SEW-ResNet-34 (68.00%). At T = 16 it reaches 74.71%, which is close to Spikformer-8-768 (74.81%) with roughly one third of the parameters, although it uses four times as many time steps.
We want to be open about the limits of this comparison. The larger spike-driven transformers still perform clearly better. At T = 1 the gap is substantial: 37.92% for StageCal against 78.0% for Meta-SpikeFormer. These models were designed for spiking dynamics and optimized at the target time step. A converted network whose ReLU backbone stays frozen cannot fully recover this at a single step. We read our T = 1 and T = 2 results as a large improvement within post-training conversion (Table 2). They do not close the gap to state-of-the-art direct training.
The two families also work under quite different assumptions, and we think this matters when judging practical competitiveness.
We therefore see StageCal as complementary to direct training. It is suited to cases where a strong pretrained ANN already exists and retraining at ImageNet scale is impractical. In the revision, we will add Table R1 and this discussion to Section 4.2 and include direct training methods more explicitly in the related work.
Thank you again for this constructive suggestion. We hope our response addresses your concern, and we would be glad to discuss any remaining questions.