- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes a frequency-lineage protocol. The main claim is that the decay of certain frequency band does not represent the loss of information while the interaction between different frequency bands does not mean the retain of the information. The experiments test the cross-frequency band interaction under the condition of different non-linear function and the effect on the classification loss led by recovering certain frequency bands on several benchmark datasets and common SNN baselines.
Critical strengths
- Interesting research question: The authors investigate the distinction between spectral attenuation and task-relevant information in spiking neural networks, while emphasizing that the decay of certain frequency band activity is not related to the loss of information and the reaction between different frequency band does not mean the retain of information.
- Reasonable experimental setting: The frequency-lineage protocol studies the different effects caused by operator responses, fixed decoder sensitivity, and functional interventions, which provides a structured perspective for analyzing frequency activity in SNNs.
Critical weaknesses
- Limited novelty: Cross-frequency generation is a trivial and well-studied consequence of nonlinear operations, since the nonlinearity caused saturation will naturally lead to different hamornics. Although the author acknowledge this, the paper does not demonstrate what new understanding of the mechanism is gained from the observation of SNNs and the chosen datasets. The methods novelty shows as the combination of spectral perturbation, decoder probing, and activation patching, which is not convincing of new methodology knowledge.
- Unclear scientific contribution: The experiments do not establish whether task-relevant information is preserved, or evicted. Except for the the acknowledged limitation in the paper, the remaining experimental results still provide limited evidence of a new computational mechanism.
- While Figure 2 shows cross-frequency perturbation effects, it does not demonstrate their modification or improvement to the original classifier.
- In Figure 3, cross-band-targeted binary patches yield modest CE recovery (+0.0115 nats), whereas joint non-source-band patches yield negative recovery (−0.0036 nats). Besides, these patches are not strictly frequency-isolated, therefore, the observation could not lead to clear causal attribution of the observed improvements to specific frequency components.
- Insufficient evaluation of the proposed protocol. The work does not demonstrate whether special perturbation measurements or fixed-decoder responses can predict the effectiveness of the downstream interventions. Therefore, the proposed protocol remains descriptive instead of a feasible mechanism to bring functional benefits. Meanwhile, the advantage of the proposed protocol over there analysis techniques is not transparent.
- Limitation in experiemental design. The selected datasets which are commonly used for SNNs classification tasks do not explicitly require temporal frequency information. This problem make the benefits brought by the proposed protocol less direct. Besides, the use of only 16 time steps constrain frequency resolution.
Questions for authors
- Scientific contribution: Given to the well-estabilished studies on the nonlinear functions, what new insights are provided beyond conventional spectral perturbation analysis?
- Causal validation: Although the authors acknowledge some limitations of the work, such as the observed cross-frequency responses do not create information persistent, decoder sensitivity does not demonstrate original-classifier use, and the interventions do not permit clear frequency-specific causal attribution, my question is what concrete scitific findings can be drawn from the experimental results?
- Size of the eval datasets: In DVS128Gesture, only tens of samples are evaluated, could that support the claimed scientific findings?