- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes temporal quotient smoothing for certifying robustness to count-preserving spike retiming. It first partitions the timeline into blocks and then within each block replaces the events with a fixed canonical arrangement that has the same count. Meanwhile, it designs the partition distribution to minimize the displacement introduced by smoothing and formulates a partition LP, gives a compact dual hierarchy and a coloring/path-cover construction. Experiments on MNIST, N-MNIST and DVS-Gesture at B=2 compare Period-5 with an AON kernel and other baselines.
Critical strengths
- This paper discusses an emerging certification problem for spiking neural networks against spike-retiming attacks.
- This paper provides a solid mathematic derivation for the proposed certificate and the compact optimization formulation.
- This paper is well motivated, where Standard randomized smoothing does not apply to binary event streams and the block-count quotient solves this simply.
Critical weaknesses
- The practical significance of the evaluated attack budget is unclear. The budget of the proposed certification is B=2, while at this budge, the only reported attack on an undefended model flip none of 274 DVS predictions, and no B=2 attack results are given for MNIST or N-MNIST. More comprehensive experiments are needed to establish whether this budget poses a meaningful threat.
- The overall writing of this paper makes reader hard to follow. This paper presents lot of mathematics while lacks a clear hierarchy among those propositions and theorems. This paper also utilizes substantial combinatorial-optimization terminology with limited intuition. A structural revision is recommended to prioritize its core methodology such as quotient construction, operational certificate, and kernel design.
- The connection between the optimization theory and classification benefits is weak. A large part of the paper studies how to minimize the displacement caused by smoothing. However, the paper’s own experiments show that reducing displacement can lower certified accuracy. AON also outperforms Period-5 on the compact DVS model. The mathematical results may be solid, but their benefit to classification remains unclear.
- The experimental settings are limited. This paper evaluates AON, calibrated p4, and a specific DSSN-JCR adaptation, with the latter evaluated primarily on MNIST. These comparisons do not sufficiently establish the proposed method’s advantage over other feasible smoothing designs under the same threat model. Additionally, the N-MNIST improvement is evaluated on a single checkpoint, while the comparison with AON reverses on the compact DVS model.
Questions for authors
- Can the author explain the practical significance of certifying robustness with B=2? Could you report a strong attack at the certified budget on all datasets and discuss whether a meaningful budget can be reached.
- What is the inference latency and energy overhead compared with the undefended SNN?