- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this work, the authors propose CTMC based ANN-to-SNN conversion method as a generalised framework for different activation functions. Previous methods, which mainly focused on ReLU-based activation functions, in this work they extend it for other activation functions like sigmoid, softplus, and others, particularly for monotonic functions. They propose to use a 3-state CTMC neuron model to match the nonlinearity of the activation functions by matching the CTMC spike emission state with the corresponding ANN activation function. They derive a closed-form expression for the stationary firing rate and optimize the transition-rate parameters by minimizing the approximation error between the CTMC firing rate and the target activation function.
Critical strengths
- This paper highlights that the majority of the ANN-to-SNN conversion methods primarily focus on ReLU activation-based ANN models, ignoring other activation function-based ANN models.
- The proposed CTMC-neuron model is particularly interesting, and the motivation for using this model is clear.
Critical weaknesses
- It's not clear why the CTMC neuron model needed to be a 3-state model, why not another number of states? Particularly, why is this topology preferred?
- Why are only a few parameters optimised in the expression as shown in equation 3, why not others (a,b are optimised c, d are not)?
- How are the values of c and d set? What kind of optimizer is used to optimise the expression, how many iterations, step size, and other details?
- I understand that the majority of ANN-to-SNN conversion methods primarily focus on ReLU activation-based neural networks. However, the experimental evaluation lacks comparisons with recent ANN-to-SNN conversion methods. I suggest the authors compare their method with recent methods such as [1], [2], as well as the relevant baselines reported in these works. [3] is also relevant because it uses probabilistic spiking neurons.
- The proposed CTMC neuron model may approximate the spike rate of different non-linear activation functions, however, this method may introduce additional computational overheads, which might reduce the benefits of energy efficiency of SNN. Particularly, during inference, it needs to compute stochastic sampling (for transitions), transition rate calculations. It's not clear how many such operations are needed and what the computational overhead for these operations is.
- The presentation of the paper needs improvement, particularly the organization and placement of the figures. The figures take up the majority of the space in the main paper. In Figure 1, subplot A, is it necessary? In Figure B, the subplots could be arranged in a single row instead of 2 rows. Similarly, Figures 3 and 4 could be better organized and aligned to improve readability and reduce the space occupied by the figures.
[1] Inference-Scale Complexity in ANN-SNN Conversion for High-Performance and Low-Power Applications [2] Differential Coding for Training-Free ANN-to-SNN Conversion [3] Temporal Misalignment in ANN-SNN Conversion and its Mitigation via Probabilistic Spiking Neurons
Questions for authors
Please check the weaknesses section.
4 comments
4. Computational overhead during inference (Q5)
The proposed CTMC neuron model may approximate the spike rate of different non-linear activation functions, however, this method may introduce additional computational overheads, which might reduce the benefits of energy efficiency of SNN. Particularly, during inference, it needs to compute stochastic sampling (for transitions), transition rate calculations. It's not clear how many such operations are needed and what the computational overhead for these operations is.
Response: Thank you for raising this question. To clarify the computational requirements, we have examined the per-step operations of our CTMC implementation (Appendix D). For each neuron, the two-state model updates its filtered input, evaluates two input-dependent transition rates, computes two exponential transition probabilities and a branching probability, and performs three uniform random draws in the current implementation.
These operations are implemented through parallel tensor computations on GPU. The sampling procedure is implementation-dependent and can be further simplified, for example by using a single state-dependent random draw to sample from the corresponding transition outcomes. The reported operation counts therefore characterize our current simulator rather than the minimum computational requirements of the neuron model.
A comprehensive assessment of hardware energy efficiency would require implementation-specific measurements beyond the scope of the present study.
5. Figure organization and presentation (Q6)
The presentation of the paper needs improvement, particularly the organization and placement of the figures. The figures take up the majority of the space in the main paper. In Figure 1, subplot A, is it necessary? In Figure B, the subplots could be arranged in a single row instead of 2 rows. Similarly, Figures 3 and 4 could be better organized and aligned to improve readability and reduce the space occupied by the figures.
Response: We thank the reviewer for the suggestions on figure organization and readability. We have revised the layouts of Figures 2 and 3, arranging their panels more compactly and consistently to improve alignment, readability, and space efficiency. We have also revised Figure 4A to present absolute SNN accuracy, facilitating a more direct interpretation of the accuracy–cost trade-off.
Regarding Figure 1, we have chosen to retain its original structure, including Panel A. As our work connects ANN-to-SNN conversion with finite-state stochastic neuron dynamics, we believe this introductory illustration provides useful context, particularly for readers less familiar with the field. We retain the arrangement in Panel B to maintain a clear association between the IF and LIF membrane trajectories and their corresponding firing-rate curves. Together, these panels establish the conceptual connection between conventional activation functions and spiking-neuron responses before introducing our CTMC construction.
I would like to thank the authors for their response. I liked the CTMC method as a generalised framework for ANN-SNN conversion, but I believe the manuscript still has some limitations. After reading their discussion with other reviewers and considering the current version of the paper, I will stand by my score. I request that the authors improve the presentation of the manuscript and include the modifications suggested by the reviewers to make it complete.
I believe this work will also benefit from showing how feasible it is to deploy on actual hardware; for example, it needs sampling for transitions between states and others.
Thank you for your follow-up and for recognizing the value of our generalized CTMC framework for ANN-to-SNN conversion. We would like to emphasize that we have responded to each of the concerns raised in your original review and respectfully request that you reconsider your assessment.
1. Scope and primary contribution
The objective of this work is not to outperform existing conversion methods in computational efficiency, but to develop a generalized ANN-to-SNN conversion framework that accommodates different activation functions. There is no universally optimal activation function. Our framework enables the conversion of ANNs while preserving their original activation behavior, supported by a theoretical approximation guarantee and experimental validation. We also recognize the importance of hardware deployment, although hardware-level efficiency has never been a claimed contribution of this work.
From the outset, we have clearly defined the scope of this work and acknowledged its efficiency limitations. Superiority in computational efficiency is neither the objective nor a claimed contribution of our framework. We therefore respectfully ask that these acknowledged limitations not serve as the primary basis for maintaining the original rating.
2. Additional experiments and manuscript revisions
In direct response to your original concerns, we have made the following revisions:
- Q1: Additional state-count ablation and justification of neuron topology (Appendix F).
- Q2 & Q3: Detailed parameterization, optimization, and calibration procedures (Section 3.2, Appendices E and G).
- Q4: Additional experimental comparisons with Inference-Scale and DCGS, and discussion of the recommended probabilistic spiking method (Appendix C, Section 2).
- Q5: Quantification of computational overhead, stochastic sampling, storage, and state-transition costs (Appendices D and F).
- Q6: Revised figure layouts and improved manuscript presentation.
In response to your latest comment, we have further revised the manuscript's layout and figure organization to improve readability. We remain open to further improvements. However, given our point-by-point responses, additional experiments, and substantial revisions, we would appreciate clarification on which substantive concerns remain insufficiently addressed.
We respectfully ask that the scientific contributions of our framework and the revisions addressing your original concerns be fully taken into account in your overall assessment.
Thank you again for your time and consideration.
We thank the reviewer for the detailed comments and suggestions.
1. Choice of state count and neuron topology (Q1)
Response: Thank you for raising the question. The three-state topology is not intended to be universally necessary or optimal. Rather, we select compact neuron structures based on the target activation. The two-state model provides a linear positive-input tail suitable for ReLU and softplus, while introducing a third refractory state allows the recovery rate to control the firing-rate ceiling, enabling saturation for sigmoid-like activations.
To further examine the role of state count, we added an ablation with fully connected CTMC neurons ranging from 2 to 20 states (Appendix F, Table 4). Although increasing the number of states substantially improves stationary-rate fitting, it also increases estimated storage and transition counts without improving SNN classification accuracy in our softplus MLP experiment. These results support our choice of compact, activation-dependent topologies as a practical balance between expressivity and complexity.
2. Fitted parameters and optimization details (Q2 & Q3)
Response: Thank you for the questions. In our three-state model, all four transition rates are parameterized and optimized, rather than only a and b. Specifically, a(H) and c(H) are input-dependent, while b and d are input-independent but remain trainable. All six parameters (a0,b0,c0,d0,wa,wc) are jointly optimized for each layer. The prescribed lower bound dmin ensures a positive recovery rate. We have clarified these distinctions in Section 3.2 and Appendix E.1.
We use Adam with an initial learning rate of 10−2 and cosine annealing, optimizing for 8,000 steps per initialization for MLPs and 16,000 steps for VGG-11. Three-state fitting uses multiple prescribed initializations, retaining the parameters with the lowest fitting loss. Appendix E further specifies the fitting domains, sampling grids, initialization choices, and optimization settings.
3. Comparison with recent ANN-to-SNN conversion methods (Q4)
Response: We appreciate the reviewer's suggestion. We have expanded Appendix C to include comparisons with conventional IF, Inference-Scale (Bu et al., 2025), and DCGS (Huang et al., 2025), including both plain and delayed evaluation for Inference-Scale. We also discuss the related two-phase probabilistic spiking approach (Bojković et al., 2025) in Section 2.
The results confirm that recent methods achieve substantially lower SynOps on ReLU networks. For VGG-11/CIFAR-10, DCGS achieves 0.209G SynOps, while Inference-Scale with delayed evaluation requires 0.486G under the reported accuracy-gap criterion (Table 2).
Our primary contribution lies in activation flexibility at the spiking-neuron level. While Inference-Scale primarily targets ReLU conversion, DCGS extends to non-ReLU operations through differential graded units that explicitly evaluate the original nonlinear functions. In contrast, CTMC neurons approximate diverse nonnegative activations directly through their stationary spike flux, without requiring separate activation-specific computation modules.
Our uniform approximation theorem establishes the theoretical foundation for this approach, while the successful conversion of sigmoid, softplus, and ReLU networks demonstrates its practical feasibility using compact two- and three-state neurons.