- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MEMSA, a temporally and spatially local learning rule for spiking neural networks built upon TESS. The method combines multi-scale eligibility traces, an activity-dependent surrogate-gradient window, and homeostatic threshold adaptation. Layer-wise learning signals are generated using fixed binary projections, avoiding cross-layer error backpropagation. Experiments with VGG-9 on three datasets show an improvement over TESS on CIFAR10-DVS, a small improvement on DVS Gesture, and unchanged mean accuracy on CIFAR-100.
Critical strengths
-
The paper addresses an important problem: improving SNN training while avoiding the storage and communication requirements of full spatiotemporal backpropagation.
-
The three components have clear motivations and operate at complementary stages of learning: retaining temporal information, adjusting surrogate-gradient support, and regulating neuronal activity.
Critical weaknesses
-
The contribution beyond TESS is primarily incremental. Full spatiotemporal locality and the stated asymptotic scaling are inherited from the underlying framework. The added components combine multiple exponential traces, activity-dependent surrogate-gradient widths, and homeostatic threshold control. The paper does not sufficiently establish why this particular combination constitutes a substantial methodological advance. Comparisons with tuned single-scale traces, fixed surrogate-gradient widths, and simpler threshold adaptation would help distinguish the benefits of adaptivity from those of additional tuning.
-
The empirical gains are concentrated on one dataset. Relative to TESS, MEMSA improves CIFAR10-DVS by 1.64 percentage points, but increases DVS Gesture accuracy by only 0.18 points and leaves CIFAR-100 mean accuracy unchanged. All experiments use VGG-9, limiting evidence for generality across architectures. Moreover, sequences contain only 6–20 time steps, so the claimed benefit of multi-scale temporal dependencies would be more convincingly demonstrated through experiments varying sequence length or requiring longer temporal credit assignment.
-
The complexity analysis does not clearly account for the complete training procedure. Equation (19) counts local projection operations, but the forward synaptic computation and weight-update operations in Equation (17) also incur costs. Likewise, the stated memory complexity describes neuronal states and traces rather than total training memory, which includes weights and Adam optimizer states. These quantities should be distinguished explicitly. Measured runtime and peak memory, including the overhead of the three additional mechanisms, are needed to substantiate the practical efficiency claims.
-
Several implementation details necessary for reproduction are missing. Section 2.3 does not fully specify the conflict-aware blending coefficient, the reference energy, or the normalization procedure. The non-causal time constants and several surrogate-gradient and threshold-controller parameters are also insufficiently documented. For STA, the definition of the long-term error, its interaction with the short-term offset, and the annealing/freezing schedule need clarification. Complete pseudocode and a consolidated hyperparameter table would substantially improve reproducibility.
Questions for authors
-
How does MET compare with a tuned single-scale trace under the same hyperparameter-search budget? Does its advantage increase with sequence length?
-
What are the results for the three pairwise component combinations? Is the full configuration consistently better across seeds?
-
Can the authors provide a complete update algorithm, including trace normalization, conflict-aware blending, threshold adaptation, and the timing of optimizer updates?
-
What are the measured training time and peak memory of MEMSA, TESS, and BPTT under identical settings? Which operations and stored quantities are included in the complexity comparison?
3 comments
Review
Thank you for the detailed response and additional experiments.
Table 2 shows that MEMSA’s largest gain over TESS is on CIFAR10-DVS (+1.64 percentage points), with a small gain on DVS Gesture (+0.18 points) and unchanged mean accuracy on CIFAR-100. The response confirms that matched pairwise ablations are still missing, so it remains unclear whether all three mechanisms are needed. The MET comparison uses TESS’s reported configuration, leaving its advantage over a single-scale trace tuned with the same search budget, and across different sequence lengths, unresolved. The new measurements clarify the efficiency trade-off: MEMSA uses less peak GPU memory than BPTT, but takes about 41% longer per epoch and uses about 20% more peak memory than TESS. For reproducibility, please also specify how the conflict-aware blending coefficient and reference energy are computed. I maintain my original rating.
Q1: Table 2 shows that MEMSA’s largest gain over TESS is on CIFAR10-DVS (+1.64 percentage points), with a small gain on DVS Gesture (+0.18 points) and unchanged mean accuracy on CIFAR-100. The response confirms that matched pairwise ablations are still missing, so it remains unclear whether all three mechanisms are needed. The MET comparison uses TESS’s reported configuration, leaving its advantage over a single-scale trace tuned with the same search budget, and across different sequence lengths, unresolved. The new measurements clarify the efficiency trade-off: MEMSA uses less peak GPU memory than BPTT, but takes about 41% longer per epoch and uses about 20% more peak memory than TESS. For reproducibility, please also specify how the conflict-aware blending coefficient and reference energy are computed. I maintain my original rating. A1: Thank you for identifying the remaining evidence and reproducibility gaps. We agree that matched ablations and equal-budget comparisons are important. At the same time, we would like to distinguish the benefits supported by the current results from the broader claims requiring further validation.
Contribution and existing evidence. MEMSA coordinates three distinct aspects of the learning update: MET preserves activity histories across decay ranges, MSG adjusts gradient sensitivity according to neuronal activity, and STA regulates subsequent firing through feedback. Importantly, MET does not simply replace the reference trace with a multi-scale mixture. Magnitude matching and deviation-aware residual fusion constrain the influence of additional temporal information. This controlled integration is a concrete design feature, rather than merely an increase in tunable parameters.
The clearest accuracy benefit is the 1.64-point improvement on CIFAR10-DVS. DVS Gesture and CIFAR-100 provide evidence of comparable baseline performance, not significant improvements. Accordingly, our claim is task-dependent improvement while retaining competitive performance on the other evaluated tasks—not uniform superiority.
Commitment to additional comparisons. We will complete matched pairwise and full-configuration ablations across multiple seeds, using consistent backbones, preprocessing, training budgets, and evaluation protocols. We will report means and variability rather than only the best runs. These experiments will assess both beneficial interactions and combinations whose effects may offset one another. We do not assume that the full configuration must rank first for every seed; the objective is to establish the empirical justification for combining all three components.
We will also compare MET with single-scale traces tuned under the same search budget and examine different sequence lengths. TESS’s reported configuration is a direct baseline, but does not eliminate the possibility of an advantage from additional tuning. MET is intended to retain useful activity across heterogeneous temporal ranges, not to guarantee larger gains whenever sequences become longer. The additional comparisons will test this specific hypothesis.
Efficiency trade-off. The current measurements show approximately 67% lower peak allocated GPU memory than BPTT, but approximately 20% higher peak memory and 41% longer training time per epoch than TESS. We therefore emphasize retaining a memory advantage over BPTT while introducing richer temporal and activity regulation, not universal acceleration. The asymptotic properties are inherited from TESS, and the practical overhead of the additional mechanisms must be stated explicitly.
Reproducible fusion definitions. Let denote the central-index reference trace, the driving activity, and the Gaussian-weighted, area-corrected mixture. Define as the mean absolute magnitude of . The reference magnitude is
The matching gain and matched mixture are
The deviation and effective blending coefficient are
The fused trace is . Thus, “reference energy” means mean absolute magnitude, not squared energy. “Conflict” means trace-magnitude deviation, not gradient-direction conflict. Larger deviations reduce the multi-scale correction. Taken together, the current results support a task-specific accuracy benefit and a measured memory advantage over BPTT. The additional comparisons will assess whether these benefits persist under matched tuning budgets and whether the three components provide complementary gains. We will align the final claims with those outcomes.
Authors' Response
Thank you very much for taking the time to review and for your support We try our best to address your questions as follows.
Q1:How does MET compare with a tuned single-scale trace under the same hyperparameter-search budget? Does its advantage increase with sequence length?
A1: Our single-scale baseline uses the optimal configuration reported by the TESS authors, not an arbitrarily weakened one. Adding only MET to MEMSA improves the average accuracy on CIFAR10-DVS from 75.00% to 75.93% (+0.93 percentage points).
MEMSA's main contribution is not to claim that multi-scale traces universally dominate, but to jointly address three distinct issues. MET provides multi-scale historical evidence, MSG modulates the activity-dependent surrogate gradient window, and STA regulates neuronal excitability.
Regarding MET's advantage, it preserves activity history across different decay rates and forms the temporal information required for the current update through controlled fusion. When both recent and earlier activities are informative for classification, it is better positioned to capture both than a fixed single scale. However, a longer sequence does not guarantee a greater advantage. If added time steps are redundant or irrelevant, longer traces may introduce interference; the effective scale must cover the historical range truly required by the task.
Q2: What are the results for the three pairwise component combinations? Is the full configuration consistently better across seeds?
A2: MET, MSG, and STA target temporal information preservation, gradient-sensitive regions, and neuronal activity regulation, respectively, providing a functional complementarity rationale for our design. However, we agree that functional complementarity alone does not guarantee higher accuracy when combined, nor does it substitute for a comprehensive combinatorial ablation. Currently, we lack fully comparable results under identical settings and random seeds for all pairwise and full configurations. Therefore, the existing evidence is insufficient to support the claim that "the complete MEMSA outperforms all combinations across every random seed," and we do not regard this as a necessary condition for the method's validity.
Mechanistically, the three components interact: STA alters subsequent firing activity, which in turn affects MSG's activity statistics and MET's input history, while MSG modulates how eligibility traces participate in weight updates. Consequently, the combined effect is not necessarily a simple summation of individual module gains. In future work, we will complete the full ablation studies to verify these interactions among the three modules.
Q3: Can the authors provide a complete update algorithm, including trace normalization, conflict-aware blending, threshold adaptation, and the timing of optimizer updates?
A3: Regarding the four key mechanisms you are concerned about, their specific implementations in the algorithm are as follows: (1)Trace normalization: The algorithm respectively calculates the exponentially decaying accumulations of the pre-synaptic trace and the post-synaptic trace, and completes the normalization and extraction of trace features through a non-linear transformation function. (2)Conflict-aware blending: The gradient is composed of the contributions of the pre- and post-traces (weighted by their respective coefficients), and interacts with the learning signal through element-wise multiplication, thereby achieving the perception and balancing of potential conflicts. (3)Threshold adaptation: Involves lines 7 and 14. Line 7 calculates the dynamic threshold as the maximum value between the sum of the base threshold and the threshold offset (constrained to a minimum of 0.5); Line 14 utilizes a specific function to update the threshold offset and the average firing rate based on the current output. (4)Timing of optimizer updates: As shown in lines 3 and 19-20. The gradient is accumulated step-by-step throughout the entire time sequence. Only after this temporal loop ends (i.e., when the sequence processing is complete), is a single Adam optimizer step executed at line 20.
Q4: What are the measured training time and peak memory of MEMSA, TESS, and BPTT under identical settings? Which operations and stored quantities are included in the complexity comparison?
A4: Experimental results show that TESS achieves a throughput of 126.42 samples/s, an average training time of 71.19 seconds/epoch, and a peak allocated memory of 2060.14 MiB; MEMSA achieves a throughput of 89.35 samples/s, an average training time of 100.72 seconds/epoch, and a peak allocated memory of 2478.45 MiB; BPTT has the highest throughput of 273.99 samples/s and the lowest average training time of 32.85 seconds/epoch, but its peak allocated memory is the highest at 7610.18 MiB.