- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes the Risk-Calibrated Surrogate Gradient (RCSG) to enhance the adversarial robustness of SNNs by reducing Gadient Risk Exposure (GRE) to membrane states that are vulnerable to spike flipping.
Critical strengths
(1) Experimental results on CIFAR-10, CIFAR-100, and Tiny-ImageNet demonstrate the effectiveness of the proposed method in improving adversarial robustness.
(2) The paper provides a relatively comprehensive ablation study to investigate the contributions of different components of RCSG, which helps validate the effectiveness of the proposed RCSG.
Critical weaknesses
(1). In my opinion, conventional surrogate gradients are designed to approximate the derivative of the Heaviside step function, which is a Dirac delta function in the distributional sense. However, RCSG suppresses the gradient near the firing threshold (), where the Dirac delta is concentrated. This design appears to contradict the original motivation of surrogate-gradient learning. Intuitively, such a design may introduce a greater mismatch between the surrogate gradients used in backpropagation and the actual forward spiking dynamics.
(2). The paper is hard to follow because of heavy notations and formulations.
Questions for authors
(1). What is the surrogate gradient used when testing attack methods? Did the authors evaluate multiple attack-time surrogate gradients and report the worst-case robust accuracy, or did they simply select one independent surrogate gradient? Furthermore, several important experimental details are not clearly specified in the paper, such as the number of PGD iterations.
(2) Figure 3(b) presents the clean–robust accuracy trade-off under different calibration strengths. However, the corresponding hyperparameter values are not provided, making it difficult to interpret the observed trends. In particular, RCSG exhibits a non-monotonic relationship between clean and robust accuracy. Could the authors explain the underlying reasons for this non-monotonic behavior?