- Rating
- 3
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The submission addresses layer-local, label-free representation learning in SNNs. Its point of departure is Self-Contrastive Forward-Forward (SCFF) learning, in which a positive pair comprises two views of the same sample and a negative pair comprises two different samples, and in which the local goodness is evaluated on a fused representation of the pair. The authors identify a mismatch between how such pairs are constructed and how they are evaluated: pairs are defined by the relation between two observations, whereas the goodness function quantifies only the magnitude of the fused response, so that pairs exhibiting distinct patterns of cross-branch spike agreement may nonetheless receive comparable scores. The proposes Pair-aware SCFF retains the two branch spike responses separately and evaluates a pair by combining two quantities. A stop-gradient, minibatch-level prevalence reweighting additionally suppresses channels that fire for most inputs, and a self-pairing Pair Stream propagation preserves the correspondence between the two members across depth while maintaining layer-local optimization, since propagated representations are detached. Validation consists of a controlled comparison against a matched Spiking SCFF implementation that shares the backbone, neuron model, support-view construction, optimizer, per-layer training budget, frozen linear evaluator, and seeds, conducted across six static-image and two event-based datasets with three seeds, which reports gains of up to 10.71 percentage points on CIFAR-100. The paper further reports component ablations, alternative relation formulations, threshold-robustness studies, and pair-level diagnostics demonstrating that improved layer-wise frozen-probe accuracy does not require improved separability of the raw fused pair score. Comparisons against published unsupervised and self-supervised SNN methods are also reported and are explicitly identified as cross-protocol. The authors release training code comprising both matched trainers, the component-ablation experiments, and the analysis switches underlying the diagnostic figures.
Critical strengths
- The paper isolates a real and previously unaddressed mismatch, and the comparison measures what it claims to measure. Positive and negative examples in self-contrastive forward-forward learning are defined by a relationship, yet the goodness that ranks them is a property of the fused response magnitude alone. Everything except the propagated stream and the goodness function is held fixed across the comparison: same backbone, neuron model, support-view construction, optimizer, per-layer training budget, frozen linear evaluator, and seeds.
- The paper establishes a non-obvious decoupling between a widely used diagnostic and actual representation quality. Section 4.3 and Appendix C show that improved layer-wise frozen linear-probe accuracy does not require a corresponding increase in same/different-class AUROC of the raw fused pair score, with a supporting argument for why the two quantities need not be ordered (Equations 29-36) and a controlled sweep over explicit separation pressure (Appendix C.4).
Critical weaknesses
- The reported improvement is established against a single, self-implemented baseline, and its magnitude is not anchored to the strongest available reference point. All eight headline comparisons use a matched Spiking SCFF implementation constructed by the authors, which holds backbone, neuron model, support-view construction, optimizer, training budget, evaluator, and seeds fixed. That control is methodologically appropriate, and the concern here is not with the fidelity of the comparison but with the breadth of the reference set: the other forward-forward SNN methods cited in the paper (FF-SCP, Terres-Escudero et al., 2025; FF-SNN, Ghader et al., 2025) are not used as baselines, and no comparison against an independently reported SCFF adaptation is given. The consequence is that the improvement is established relative to one particular reference configuration rather than against the current best alternative, which limits how much weight the headline gains can carry. This is addressable by reporting the additional baselines, or by stating explicitly why the chosen reference is the appropriate one.
- The contribution is narrower than the title and abstract indicate. Appendix B.1 shows that the specific functional form of the relation statistic is close to interchangeable, with centered Dice, no prevalence reweighting, and normalized covariance all falling within roughly one percentage point of the full formulation, while the component ablation shows the gain factor is essential only in interaction with the evidence term. The evidence therefore supports a conjunctive evidence and relation criterion rather than the particular relational formulation that the paper advertises as its contribution. This is a matter of claim scoping rather than technical error. The mechanism the ablations identify is broader than the specific statistic proposed.
Questions for authors
- Appendix B.1 shows the specific relation statistic is close to interchangeable, while the component ablation shows the gain factor matters only in interaction with the carrier. Should the contribution be characterized as a conjunctive evidence and relation criterion rather than as this particular relational statistic? A decomposition that holds the evidence term E_t fixed while varying only the relation term would make the claim precise.
- The fused-activity baseline corresponds to the SCFF formulation as stated. Is it also the strongest available SCFF configuration on this backbone? Specifically, was any tuning of the fused pathway explored before it was fixed, (for example, pre-fusion summation versus per-branch thresholds, or the normalization of the goodness)? And does an independently reported spiking forward-forward method provide a comparable same-task reference point? I note that the two other forward-forward SNN works cited in the paper do not serve this purpose directly: the method of Terres-Escudero et al. (2025) addresses out-of-distribution detection, and the work of Ghader et al. (2025) reports layer-wise forward-forward optimization, so my question concerns whether a stronger same-task reference exists rather than a request for a particular additional baseline.
4 comments
To further examine your question about threshold calibration, we evaluated the same pre-specified grid of 13 positive/negative threshold-scale pairs, , independently for Spiking SCFF and Pair-aware SCFF on CIFAR-10 and CIFAR-100. This gives 52 independently trained method–dataset–setting runs, all with seed 730. We report the final test accuracy for every setting below.
| C10 SCFF | C10 Pair-aware | C100 SCFF | C100 Pair-aware | |||
|---|---|---|---|---|---|---|
| (0.50, 1.00) | 66.84 | 71.13 | +4.29 | 37.96 | 45.54 | +7.58 |
| (0.75, 0.75) | 68.20 | 74.89 | +6.69 | 41.13 | 50.05 | +8.92 |
| (0.75, 1.00) | 70.20 | 75.00 | +4.80 | 40.54 | 49.85 | +9.31 |
| (0.75, 1.25) | 68.57 | 73.55 | +4.98 | 40.84 | 48.02 | +7.18 |
| (1.00, 0.50) | 65.52 | 73.74 | +8.22 | 37.05 | 48.76 | +11.71 |
| (1.00, 0.75) | 66.04 | 74.72 | +8.68 | 37.69 | 49.45 | +11.76 |
| (1.00, 1.00) | 67.00 | 74.89 | +7.89 | 39.69 | 50.03 | +10.34 |
| (1.00, 1.25) | 67.01 | 75.36 | +8.35 | 39.49 | 50.07 | +10.58 |
| (1.00, 1.50) | 67.03 | 75.44 | +8.41 | 39.73 | 49.66 | +9.93 |
| (1.25, 0.75) | 64.75 | 73.34 | +8.59 | 36.29 | 47.68 | +11.39 |
| (1.25, 1.00) | 66.14 | 73.94 | +7.80 | 37.92 | 49.46 | +11.54 |
| (1.25, 1.25) | 65.93 | 75.08 | +9.15 | 39.33 | 49.39 | +10.06 |
| (1.50, 1.00) | 63.62 | 73.62 | +10.00 | 35.63 | 47.83 | +12.20 |
For seed 730, Pair-aware SCFF improves over Spiking SCFF at all 13 matched settings on both datasets. The mean paired gain across the evaluated threshold grid is 7.53 percentage points on CIFAR-10 and 10.19 points on CIFAR-100. The highest observed test accuracies are 70.20% for Spiking SCFF and 75.44% for Pair-aware SCFF on CIFAR-10, and 41.13% and 50.07%, respectively, on CIFAR-100. These maxima are descriptive summaries of the sweep. Comparing each method at its own best observed thresholds preserves gains of 5.24 and 8.94 percentage points.
With the earlier Fashion-MNIST experiments, these results directly address threshold calibration on two of the larger-gain datasets you identified. Spiking SCFF benefits from threshold adjustment, but the substantial advantage of Pair-aware SCFF remains after that adjustment and across every evaluated setting.
Thank you again for your feedback on baseline coverage and the scope of the contribution. We added comparisons with adapted CSDP and FF-SNN under a shared backbone and Fashion-MNIST evaluation protocol, where Pair-aware SCFF achieves the highest accuracy among the evaluated label-free local SNN methods. The pairing protocol also improves both adapted CSDP and FF-SNN, supporting its applicability beyond SCFF.
We further provided the ablation you requested, holding the Pair Stream and evidence term fixed while varying only the relation term, and clarified that the central contribution is the joint use of paired evidence and relational information. We also extended the threshold-sensitivity analysis to Fashion-MNIST, CIFAR-10, and CIFAR-100. Pair-aware SCFF outperformed Spiking SCFF in every evaluated matched setting.
As the discussion period draws to a close, we would appreciate your feedback on whether these additions address your concerns about baseline coverage and contribution scope, and your consideration of this evidence in your final assessment. We would be happy to clarify any remaining questions.
Thank you for your time and consideration.
The rebuttal resolves my main concerns. And I will keep my rating. Thank you for your time.
1. Broadening the Local Learning Comparisons
Thank you for your suggestion regarding the scope of the comparisons. The matched Spiking SCFF control is used to assess the effect of the proposed design; the additional experiments introduce different local learning rules to broaden the comparisons under the same backbone.
We added adapted versions of CSDP and FF-SNN, using a common three-layer CNN, 4 time steps, Fashion-MNIST, and frozen linear evaluation. The results for label-free representation learning are:
Pair-aware SCFF achieves the highest accuracy in this common setting. The pairing protocol also provides consistent improvements for CSDP and FF-SNN, indicating that its benefits can extend to different local learning rules.
The gains for both CSDP and FF-SNN show that pairing transfers across local learning rules, while Pair-aware SCFF achieves the highest accuracy among the methods evaluated under this unified local-SNN protocol.
2. Core Contribution: The Joint Role of Paired Evidence and Relational Information
We agree with the reviewer's assessment of the mechanism underlying the contribution. The core contribution of this work is to jointly incorporate pair-supported evidence and cross-branch relations into local goodness, enabling the training objective to use the relational information contained in the pair construction.
With the Pair Stream and evidence term E held fixed, replacing only the relation term yields the following results:
All relation forms exceed the 69.18% accuracy obtained using pair-supported evidence E alone. The full form achieves the highest mean accuracy, while Centered Dice and the variant without prevalence reweighting also maintain strong performance.
These results support a more general design principle: combining paired evidence with relational information is the main source of the gains, and the proposed prevalence-weighted statistic is an effective implementation of this principle. The gains retained across different relation forms also indicate some flexibility in how this principle can be implemented.
3. Fusion Path and Threshold Configuration
Our baseline retains the original SCFF fusion path, and we provide additional comparisons addressing both goodness design and threshold selection.
Wth the Pair Stream held fixed, the four goodness configurations on CIFAR-10 are:
The combination of pair-supported evidence and relation modulation achieves the highest accuracy, improving upon E alone by 6.07 percentage points. This comparison holds the paired propagation protocol fixed and directly tests the design of the local objective.
The 13 positive and negative threshold settings on Fashion-MNIST show that Pair-aware SCFF leads in all matched settings. Using each method's best thresholds within the tested grid yields accuracies of 89.98±0.17 and 91.46±0.13, respectively, retaining a gap of 1.48 percentage points. The 13-setting threshold grid was fixed in advance; test results are reported for each setting and were not used to select thresholds. This tuning retains SCFF's original fusion structure and focuses on goodness and threshold selection; other fusion structures were not included in this search. With the additional CSDP and FF-SNN controls, the available results support the effectiveness of paired evidence and relation modeling from three perspectives: local objectives, threshold configuration, and learning rules.