- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This empirical study examines how activity objectives alter mean firing, within-input population firing-rate CV, and dataset-level silent-coordinate participation in a four-timestep Spike-Driven Transformer. Maximizing a per-input CV auxiliary statistic paradoxically produces much lower evaluated hard-spike CV and a larger silent set at competitive accuracy. The paper employs multi-seed matched comparisons, common-checkpoint continuations, tensor-aligned endpoint readouts, objective-component tests, per-input/lifetime Hoyer controls, validation-selected confirmation, and several cross-system boundary experiments.
Critical strengths
- The observation is unusually informative despite not being a new architectural block. On CIFAR-10, PopFR-CV shifts evaluation CV from 19.15 to 1.664 and the equal-tensor silent-coordinate fraction from 22.05% to 52.81%, while keeping mean accuracy comparable or better (Table 2). This makes the distinction between aggregate firing, per-response dispersion, and population participation tangible.
- Strong and candid experimental controls. Paired continuations restore a complete mature model/optimizer/random state, separating intervention from independently trained endpoints. The common-nonzero analysis localizes the aggregate CV shift primarily to attention-path response withdrawal, without claiming proof of functional dispensability. Further Hoyer, numerical-component, seed-level, and cross-system analyses disclose failures and unresolved mechanisms instead of suppressing them.
Critical weaknesses
- The main phenomenon is not yet a general property of spiking regularization. Its complete low-CV/large-silence/preserved-accuracy pattern is well reproduced within T=4 SDT on three static-image datasets, but not in the tested native SEW-ResNet, MNIST spiking MLP, or CIFAR10-DVS condition (Appendix D, Tables A12–A14). Because activation inventories, loss strengths, and optimization differ across these systems, those contrasts bound scope without identifying why the response is system-dependent. The authors openly acknowledge this limitation.
- The proposed interpretation remains descriptive rather than a validated causal mechanism or efficiency design rule. Attention-path withdrawal is strongly associated with the CV reversal, but an intervention preserving attention occupancy is not performed, and the influences of surrogate gradients, clipping, boundaries, and optimizer history are not uniquely resolved. Importantly, an energy model is already supplied: Appendix G, Table A21 estimates only about 4.1% (CIFAR-10) and 1.4% (CIFAR-100) lower arithmetic energy for PopFR-CV, excluding device overheads. The substantive contribution is population-organization insight, not demonstrated computational acceleration.
Questions for authors
- Can the authors provide a targeted, source-matched experiment or analysis that separates architecture from effective regularizer strength and response inventory in one additional system? A broad new benchmark sweep is not necessary to clarify the claimed scope.
- Does constraining occupancy in the monitored attention pathways during PopFR-CV adaptation attenuate or redirect the objective–outcome inversion?
- Which of the documented local-gradient/surrogate and objective-component diagnostics best rules out simple explanations of the inversion, and what remains unidentified?
Thank you for the detailed rebuttal and additional experiments. I appreciate the authors' efforts, and I believe most of my concerns have been substantially addressed. In particular, the new intervention and branch-removal experiments strengthen the scientific contribution of the paper. However, some concerns remain regarding the generalizability of the findings and the precise mechanism underlying the observed phenomenon. Nevertheless, I believe the paper provides valuable insights into population dynamics in SNNs. Therefore, I will maintain my rating of 3 (Weak Acceptance).