-
W1. Innovation and novelty are limited, and the paper lacks sufficient justification for the originality of the proposed methods. Specifically, FGFKD is highly similar to BKDSNN[1] (ECCV 2024), with the only change being the replacement of uniform random masking probability with an adaptive probability based on the firing rate of student channels. Therefore, the main technical change in FGFKD is focused on the masking sampling strategy rather than a new feature distillation mechanism. FGLKD is highly similar to DKD[2] (CVPR 2022), as it follows the same basic decomposition approach and KL divergence optimization objective, with only the fixed weight in non-target class distillation replaced by a dynamic weight determined by the average firing rate of samples. This essentially constitutes a sample-level adaptive reweighting of existing distillation losses. The main contribution lies in incremental adjustments to existing mechanisms rather than proposing a new knowledge transfer paradigm.
-
W2. The core experiments lack key combination baselines, weakening the independent contribution of the proposed mechanism. Since this paper mainly introduces a firing rate-guided mechanism on existing feature distillation and decoupled logit distillation frameworks, the experimental design should focus on verifying the independent benefits brought by these new mechanisms compared to the original methods and their direct combinations. The paper lacks the following critical comparisons: (1) BKDSNN[1] (Uniform Mask) + standard DKD[2]; (2) FGFKD + standard DKD; (3) BKDSNN (Uniform Mask) + FGLKD. These sets of experiments are crucial for further evaluating the unique contributions of the Firing-Guided distillation mechanism. Additionally, if the adaptive knowledge distillation mechanism based on spike firing activity is the main innovation of this paper, the authors should further validate its generality and transferability by introducing it into other existing SNN feature distillation frameworks (such as CKDSNN[3], LaSNN[4], MEOM[5], and Efficient ANN-Guided Distillation[6]), or adapting and combining it with other general ANN knowledge distillation strategies (such as CAM-KD (ICCV 2025)[7], EA-KD (ICCV 2025)[8], WKD (NeurIPS 2024)[9], SDD (CVPR 2024)[10], and SKD (CVPR 2026)[11]). This should be done while maintaining the original framework and fair experimental settings to analyze whether the Firing-Guided mechanism can also bring stable performance improvements, rather than being limited to improvements on BKDSNN. The lack of these key experiments makes it insufficient to demonstrate that the Firing-Guided mechanism has universal value and substantial technical contributions independent of specific distillation frameworks.
-
W3. The sparsity and redundancy of spike firing activity are not new research findings, and the paper lacks sufficient justification for its novel scientific insights. The sparsity, non-uniformity, and redundancy of spike firing in SNNs have already been systematically analyzed in IRSNN (ICCV 2023)[12], which discussed the relationship between firing activity, network performance, and computational efficiency. Therefore, the phenomenon shown in Figure 4(a) of this paper, where firing activity is concentrated in a few channels, while providing specific empirical statistics, does not introduce a novel concept of sparsity or redundancy. The authors need to further explain what new patterns this observation reveals compared to existing analyses of SNN firing activity. It is particularly noteworthy that previous research has indicated that spike firing activity may contain redundancy and noise, and firing frequency alone cannot be directly equated with information value or feature importance. Therefore, the concentration phenomenon in Figure 4(a) is insufficient to directly support the proposed knowledge distillation strategy. If the authors consider these observations as significant scientific contributions of the paper, they need to further clarify their differences from existing research and provide theoretical analysis.
-
W4. The method design is mainly a heuristic adjustment of existing techniques, lacking in-depth analysis of the effectiveness and generalizability of the new mechanisms. If Firing Activity can indeed effectively guide knowledge distillation, then other monotonic nonlinear mappings, such as Sigmoid, power functions, exponential functions, or normalized mappings based on firing rate ranking, could theoretically achieve differentiated supervision for high firing activity channels or samples. These functions have different sensitivities to different firing rate intervals, which may result in different distributions of knowledge transfer intensity. The authors did not explain why they chose a simple truncated linear mapping and lacked systematic comparisons of different function forms. Therefore, it is still unclear whether the performance improvement mainly comes from the effective information contained in Firing Activity or relies on specific heuristic mappings and their hyperparameter configurations. Additionally, this paper limits the mask probability of FGFKD to [0.25, 0.75] and the distillation weight of FGLKD to [0.25, 1.0]. However, the authors did not sufficiently explain the rationale for these boundary values or report the actual distribution of firing rates and mapped weights. It is particularly noteworthy that when a large number of channels or samples have firing rates below 0.25, the corresponding mask probabilities or distillation weights will be uniformly truncated to 0.25, thereby weakening or even eliminating the adaptive differences between different channels or samples. Therefore, the authors should report the statistical distribution of firing rates under different architectures, the proportion of weights concentrated at truncation boundaries, and conduct sensitivity experiments on mask probability boundaries, distillation weight boundaries, and mapping function shapes to verify whether the new mechanisms truly play their intended role.
References
[1] Xu Z., You K., Guo Q., Wang X., He Z. BKDSNN: Enhancing the Performance of Learning-based Spiking Neural Networks Training with Blurred Knowledge Distillation. ECCV, 2024. Link.
[2] Zhao B., Cui Q., Song R., Qiu Y., Liang J. Decoupled Knowledge Distillation. CVPR, 2022. Link.
[3] Liu X., Xia N., Zhou J., Xu J., Guo D. A Closer Look at Knowledge Distillation in Spiking Neural Network Training. AAAI, 40(3): 1946–1954, 2026. Link.
[4] Hong D., Qi Y., Wang Y. LaSNN: Layer-wise ANN-to-SNN Distillation for Effective and Efficient Training in Deep Spiking Neural Networks. Neurocomputing, 656: 131351, 2025. Link.
[5] Sun K., Duan P., Huang Y., Gong N., Kuhlmann L. Many Eyes, One Mind: Temporal Multi-Perspective and Progressive Distillation for Spiking Neural Networks. ICLR, 2026. Link.
[6] Yang S., Yu C., Liu L., Ma H., Wang A., Li E. Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement. CVPR, 2025. Link.
[7] Lan Q., Tian Q. ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation. ICCV, 2025. Link.
[8] Su C.-P., Tseng C.-H., Pu B., Zhao L., Yang J., Chen Z., Lee S.-J. EA-KD: Entropy-based Adaptive Knowledge Distillation. ICCV, 2025. Link.
[9] Lv J., Yang H., Li P. Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation. NeurIPS, 2024. Link.
[10] Wei S., Luo C., Luo Y. Scaled Decoupled Distillation. CVPR, 2024. Link.
[11] Jeong H.-J., Lee H.-J., Choi S.-H. Streamlined Knowledge Distillation. CVPR, 2026. Link.
[12] Yao M., Hu J., Zhao G., Wang Y., Zhang Z., Xu B., Li G. Inherent Redundancy in Spiking Neural Networks. ICCV, 2023. Link.
Sincerely looking forward to the further discussions
Dear Reviewer BqT3,
As the discussion deadline is approaching, we kindly remind that we have answered your remaining concerns carefully with additional experiments and clarification.
Could you please check our response and consider improving the rating if we successfully addressed you concerns?
Any feedback will be greatly appreciated and we are glad to provide any additional clarifications that you may need to bring a fruitful discussion.
Warm regards, The Authors