- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes PRIME, a training-free ANN-to-SNN conversion framework that replaces conventional rate coding with residual-potential amplification and multi-bit spike encoding. PRIME further maps floating-point sign/exponent/mantissa bits directly to spike representations and uses shift-and-add operations to reduce multiplication cost. Experiments on CNNs, vision Transformers, and LLMs show near-lossless conversion with very low timesteps, typically , while the paper also reports analytical reductions in inter-layer bit transmission and computational energy.
Critical strengths
- The paper presents a technically interesting and coherent redesign of ANN-to-SNN conversion.
The connection between residual membrane potential, binary representation, direct bit parsing, and shift-add inference is conceptually clean and gives the method a clear hardware-oriented motivation. - The empirical results are strong and broad.
PRIME achieves near-lossless, training-free conversion with very low timesteps across CNNs, vision Transformers, and LLMs, which makes the method substantially more convincing than a narrow proof-of-concept.
Critical weaknesses
- The relationship to modern ANN quantization and digit-serial arithmetic is not sufficiently addressed.
Numerically, PRIME keeps the exponent and decomposes the mantissa into low-bit digits/spikes, which makes it quite close to low-bit or bit-serial inference. Without stronger comparisons, it is difficult to judge what is fundamentally gained by using the SNN formulation rather than INT8/INT4 ANN inference. - The hardware-efficiency claims are still supported mainly by analytical estimates.
The energy analysis accounts for several relevant primitives, but there is no accelerator-level validation. Also, the very low timestep count should be interpreted together with the actual bit budget, since still uses a relatively rich multi-bit representation.
Questions for authors
- How does PRIME compare with strong low-bit ANN baselines under a matched accuracy and hardware budget?
In particular, comparisons against INT8/INT4 activation quantization or digit-serial inference would help clarify whether PRIME provides an advantage beyond simply changing the numerical representation. - What is the specifically SNN-related benefit of the proposed representation?
With multi-bit spikes and parallelizable timesteps, PRIME begins to resemble a hardware-oriented floating-point decomposition. I would like the authors to clarify what is gained from retaining the SNN interpretation rather than viewing PRIME as a general numerical encoding scheme (which can also be available for ANN quantization encoding). - How much of the reported energy advantage is expected to remain in a complete hardware implementation?
A clearer end-to-end accounting including control, LOD, shifting, accumulation, storage, and the remaining floating-point operations would materially affect my assessment of the hardware significance.
2 comments
W2&Q3
We thank the reviewer for the valuable comments. We understand the reviewer's concerns regarding hardware energy-efficiency estimation and the actual bit budget. First, we would like to clarify that our energy consumption analysis considers not only multiplication operations but also major operations such as sign-bit processing, exponent computation, LOD, shift-and-accumulate operations, and cross-timestep accumulation.
Regarding the multi-bit representation issue mentioned by the reviewer, we agree that a low number of timesteps does not necessarily imply low communication overhead. Therefore, in the comparative experiments presented in our paper, we report both the number of timesteps and the actual number of transmitted bits. We also provide energy consumption and data transmission analyses under different (T,D) configurations in Appendix C, allowing trade-offs based on actual hardware conditions and accuracy requirements. As shown in Table 7 of Appendix C.2, under the representative configuration of T=2 and D=3, PRIME requires 13 bits for inter-layer transmission, compared with 16 bits for FP16 and 32 bits for FP32, corresponding to reductions of 18.75% and 59.38%, respectively.
We understand the reviewer's concerns regarding the basis of our energy consumption estimates and the distinction between these estimates and actual hardware inference energy consumption. However, actual power consumption can only be measured after chip design and fabrication. Therefore, our power consumption analysis is based on the statistical results reported in [1]. Furthermore, to provide sufficient margin for practical hardware inference deployment, we adopt more conservative estimates in our theoretical evaluation. For example, for low-power bit-level operations such as Sign-bit XOR and LOD, we uniformly overestimate their energy consumption using the energy cost of an 8-bit addition. Unlike conventional ANN-to-SNN energy estimation methods, which completely ignore the energy consumption associated with spike firing, reset operations, and other processes (a single addition consumes 0.9 pJ, while a single multiplication consumes 3.7 pJ, meaning that approximately four additions or subtractions consume nearly the same energy as one multiplication; ignoring multiple such additions and subtractions may render their energy consumption analyses entirely invalid), these methods also fail to consider the data transmission overhead introduced by a large number of timesteps. We analyze our data transmission volume to determine its impact on data movement and memory access. Furthermore, we carefully account for the energy consumption of all computational processes, including LOD and other operations. Therefore, we expect that the energy-efficiency advantages of our approach will become even more significant once the chip is implemented.
[1] Mark Horowitz. 1.1 Computing's energy problem (and what we can do about it). In 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC), pp. 10–14, 2014. doi: 10.1109/ISSCC.2014.6757323.
W1&Q1&Q2
We thank the reviewer for raising this important question. We agree that, from the perspective of low-level numerical operations, PRIME shares certain similarities with low-bit ANN quantization and digit-serial arithmetic. However, we would like to further clarify that the core research objective of PRIME is not to propose a general-purpose numerical encoding format independent of SNNs, but rather to address the long-standing problems of encoding redundancy, conversion error, and hardware execution efficiency in ANN-to-SNN conversion.
PRIME is complementary to, rather than a replacement for, quantization techniques such as INT8/INT4. Quantization mainly reduces computational overhead by lowering numerical precision, whereas PRIME improves the information-carrying capacity of each spike through the Residual Membrane Potential Amplification (RMPA) mechanism and Integration Coding, improving the upper bound of conversion error from linear decay with the number of timesteps in traditional rate coding to exponential decay, thereby reducing the information redundancy caused by repeated spikes in traditional SNNs. More importantly, quantized models can still be further optimized using the PRIME framework. Experiments on models quantized to formats such as FP8 and INT4 are presented in Appendix L, "SUPPORT FOR MORE FORMATS," where energy consumption can be further reduced under our TD setting. As shown Table A and Table B, these results demonstrate that PRIME does not merely change the numerical representation, but can be combined with existing ANN quantization techniques to further reduce computational overhead on top of low-bit models.
Table A: Estimated computational energy consumption of FP8 and INT4 quantized ANN baselines and their PRIME-converted counterparts under different (T, D) configurations.
Table B: Accuracy comparison before and after PRIME conversion under different (T, D) configurations: MMLU accuracy (%) on FP8-quantized Qwen3-0.6B and ARC-Challenge accuracy (%) on INT4-quantized LLaMA2-7B (FlatQuant W4A4).
The core value of retaining the SNN framework lies in the fact that PRIME can not only be efficiently executed on existing digital hardware, but also preserve the potential energy-efficiency advantages of spike-driven computation on neuromorphic chips. Through its unique Residual Membrane Potential Amplification mechanism and Integration Coding mechanism, PRIME substantially increases the actual amount of information that can be represented by the same number of spikes, improving the error decay in ANN-to-SNN conversion from linear to exponential and significantly enhancing efficiency, while avoiding the inefficient operation of repeatedly firing spikes to represent the same information in traditional rate coding. We agree that PRIME's binary decomposition and shift-and-accumulate operations can also be applied to general ANN numerical encoding, but this is merely its implementation approach for existing digital hardware and does not change its fundamental SNN nature based on spike firing and membrane potential dynamics. Therefore, PRIME's advantage lies in simultaneously considering efficient spike encoding in SNNs, the potential for future deployment on neuromorphic hardware, and computational efficiency on existing GPU/NPU architectures, rather than merely proposing a new floating-point decomposition method.