- Rating
- 2(−1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper aims to improve the training efficiency of spiking neural networks in the compact-code domain and their energy efficiency in practical hardware deployments. The authors find that existing methods provide fragmented evidence linking SNN training to practical deployment benefits. The authors then propose the STRIDE framework, which contains two phases of STRIDE-T and STRIDE-D. The STRIDE-T combines Integer-LIF neurons with Quantization-Aware Distillation (QAD) to achieve BPTT-free W4A4 compact-code training. Also, the STRIDE-D maps compact integer codes to binary temporal spikes to support native event-driven execution on dedicated SNN hardware. Experiments based on image classification, object detection, and semantic segmentation tasks show performance in task accuracy, peak training memory, and energy per inference.
Critical strengths
Overall, the main strength of this paper lies in combining low-bit SNN training with hardware deployment and showing experiments on different computer vision tasks and hardware platforms.
(1) This paper focuses on the task accuracy and energy efficiency of low-bit SNNs in practical hardware deployment. By combining compact-code training with native event-driven execution, it reduces inference energy consumption while retaining task accuracy as much as possible, thereby offering practical value.
(2) The experiments in this paper cover three real-world vision tasks (e.g., image classification, object detection, and semantic segmentation) on three models. These results help to show the performance generalization of common computer vision tasks.
Critical weaknesses
This paper has some merit, but it still has the following two main issues.
(1) The technical contributions of the software-hardware collaboration framework lack sufficient validation. STRIDE combines low-bit SNN training, compact integer codes, and native event-driven execution on dedicated SNN hardware. However, the existing experiments lack a comparison with other training methods deployed on the same SNN accelerator, making it difficult to highlight the unique advantages of the proposed collaboration framework for training and deployment.
(2) The experiments struggle to accurately attribute energy-saving benefits. Table 3 compares the energy per inference of a dedicated SNN accelerator with that of a GPU/CPU; however, significant differences exist among these platforms in terms of execution architecture, numerical precision, and the ability to exploit spike sparsity, making it difficult to distinguish the energy-saving contributions of low-bit quantization, skipping redundant spike-weight computations, and the dedicated hardware itself. Also, the energy per inference of the SNN accelerator was extrapolated from sampled command-block measurements and lacks validation through direct end-to-end energy measurements, which further limits the persuasiveness of the cross-platform energy comparison.
Questions for authors
(1) As to the energy consumption measurement, could you directly measure the energy per inference of the dedicated SNN accelerator when executing the full model, but instead extrapolate from sampled command-block measurements to layer totals and sum them across layers? Can this method accurately reflect actual energy consumption?
(2) The proposed STRIDE has demonstrated the feasibility of deploying trained models on dedicated SNN hardware, but what are the unique advantages of its collaboration framework compared to other train-then-deploy approaches? We recommend including a comparison of models trained using other low-bit training methods on the same SNN accelerator to further validate the technical contributions of the collaboration framework.
(3) I suggest the authors conduct energy consumption ablation experiments on the same hardware platform to separately evaluate the energy-saving contributions of low-bit quantization, skipping redundant spike-weight computations, and the dedicated hardware itself.
(4) The current experiments are primarily based on static image datasets and selected models. Is STRIDE applicable to directly trained SNN architectures (e.g., SEW-ResNet, Spikformer) and DVS event-based datasets (e.g., CIFAR10-DVS, DVS128 Gesture)? We recommend supplementing the study with relevant experiments to validate its effectiveness across different SNN architectures and event-based vision tasks.
Response to Reviewer Gc8Y
We thank the reviewer for the constructive comments and address each point below.
[R1] Direct full-model energy measurement and accuracy of the command-block extrapolation
Thank you for your question. We directly measure the fabricated 28-nm accelerator’s energy over a full SpikingLETNet inference. At 0.8 V and 340 MHz, the accelerator consumes 2.29 mJ per inference above idle, excluding host-computer power. At the same operating point, the end-to-end pipeline achieves 16.12 FPS, corresponding to 62.03 ms per inference, including communication with the host. Table 3 now reports the directly measured energy and latency.
[R2] Advantages of STRIDE over models trained with other low-bit methods and deployed on the same accelerator
Thank you for your question. The primary contribution of the training stage in STRIDE’s co-design is higher task accuracy under the representation constraints of the target accelerator. A model trained by any method can use the same deployment path if its operators, bit widths, and activation encoding are supported by the target backend. For models with the same architecture, we expect comparable inference energy on a given backend when their execution patterns, including temporal skipping on the accelerator, are also comparable. The training-side benefit can therefore be assessed by comparing task accuracy under the same W4A4 representation constraints, without deploying each checkpoint on the accelerator. Table 1 provides this comparison and shows that STRIDE-T achieves higher task accuracy than all the evaluated quantization baselines.
[R3] Energy ablations for low-bit quantization, temporal skipping, and dedicated hardware execution
Thank you for your question. We compare dense W4A4 and W4A1T8 execution on the same chip. With both modes using 4-bit weights, measured power decreases from 174.64 mW in dense W4A4 mode to 123.46 mW in W4A1T8 mode, a 29.31% reduction.
To isolate the effect of temporal skipping, we measure the computation power of a single core with skipping enabled and disabled at each input spike sparsity. At 80% sparsity, enabling skipping reduces power from 84.90 to 67.46 µW. At 100% sparsity, it reduces power from 83.26 to 47.26 µW. These measurements are taken at 0.8 V and 340 MHz and exclude memory accesses.
Low-bit arithmetic is integral to the accelerator’s execution path. The accelerator exploits spike sparsity through native accumulation of 4-bit weights gated by 1-bit spikes. W8A8 is the lowest-precision integer configuration supported end to end for SpikingLETNet on the evaluated GPU and CPU backends. In Table 3, these GPU and CPU deployments consume 39.76× and 2,288× as much energy per inference as the W4A1T8 accelerator, respectively. These ratios quantify the energy advantage of the accelerator’s execution path relative to the most energy-efficient GPU and CPU configurations we evaluate. The same-chip measurements separately show how temporal skipping reduces compute-core power.
[R4] Applicability to directly trained SNN architectures and event-based datasets
Thank you for your question. We add event-based classification on CIFAR10-DVS using SpikingResNet-18. As reported in Table 1, STRIDE-T achieves (80.10±0.95)% test top-1 accuracy across three seeds, outperforming all the evaluated baselines while requiring less peak training memory than all the BPTT baselines.