- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a self-prediction enhanced spiking neuron framework that augments an existing spiking neuron with an auxiliary recurrent state. The auxiliary state integrates a weighted combination of the neuron’s historical input and its own spike output, and is then fed back into subsequent membrane integration.
Concretely, the method introduces an auxiliary state of the form
which is added to the input current at the next time step. The coefficients and control input memory and spike feedback, respectively. The authors evaluate this mechanism across multiple neuron models (IF, LIF, PLIF, and CLIF), network architectures, image classification tasks, sequential CIFAR-10, and reinforcement learning environments.
The paper reports improvements in many CIFAR-10 configurations, modest gains on ImageNet, improvements on sequential CIFAR-10, and generally positive results on the tested reinforcement learning tasks. Additional ablations examine input memory, spike feedback, gradient detachment, and learnable feedback coefficients.
Critical strengths
-
Broad empirical evaluation.
The method is tested across several neuron types, network architectures, time steps, classification tasks, sequential classification, and reinforcement learning. This breadth provides useful evidence that adding the auxiliary state can improve performance in multiple settings. -
Reasonably thorough ablations.
The paper separately studies input memory, spike feedback, gradient detachment, and learnable feedback coefficients. These ablations are valuable because they expose which components are actually contributing to the observed gains.
Critical weaknesses
-
It is unclear what is actually being “predicted.”
The proposed mechanism does not explicitly predict a future input, future spike, or latent target, nor does it optimize a prediction-error objective. Mathematically, the auxiliary state is an exponentially weighted history of the input minus an exponentially weighted history of the neuron’s own spikes. This appears closer to recurrent memory, adaptation, or autaptic feedback than to predictive coding or self-prediction. The paper should justify more clearly why the proposed mechanism should be interpreted as prediction rather than as an additional recurrent state. -
The main performance gain may come from input memory rather than the proposed spike-feedback mechanism.
In the path ablations, input-memory-only already improves substantially over the base LIF neuron. Moreover, adding spike feedback provides only a small gain for SEW ResNet-18 and actually reduces the final-five-epoch accuracy relative to input-memory-only for Spiking ResNet-18. Therefore, the evidence does not clearly establish that the input-output residual or self-feedback component is necessary. -
The learnable spike-feedback coefficient is not consistently beneficial.
Although the main text highlights gains from learning the spike-feedback coefficient on two architectures, the broader exploration over 20 architecture-neuron combinations shows improvements in 11 cases and decreases in 9 cases, with an average gain of only 0.0465 percentage points. This makes the claimed general benefit of adapting the feedback strength considerably less convincing. -
The method increases the neuron state dimension, but the paper does not provide a sufficiently strong capacity-matched baseline.
A standard LIF neuron is augmented with an additional continuous recurrent state. Therefore, part of the improvement may simply come from increasing the temporal state capacity. A key missing baseline would be a simple auxiliary leaky state driven only by the input, with comparable parameter count and state dimension, but without the proposed input-output residual or predictive-coding interpretation. -
The relationship to existing adaptive and recurrent neuron models is not sufficiently disentangled.
The proposed mechanism appears closely related to existing ideas such as adaptation currents, recurrent/self-feedback dynamics, autaptic connections, multi-timescale neurons, and auxiliary membrane states. Although these works are discussed in the related-work section, the empirical comparisons do not directly show why the proposed formulation offers a distinct advantage over representative alternatives. -
Some of the reported improvements are small or unstable.
The ImageNet-1K improvement is only 0.20 percentage points, and several coefficient ablations show architecture-dependent gains or losses. This weakens the claim that the mechanism provides a generally reliable improvement. -
The parameterization can become poorly conditioned.
In the broader coefficient experiments, the learned feedback coefficient can become extremely large while the memory-update coefficient becomes very small, suggesting a scale-compensation or identifiability issue. This raises questions about the interpretability and numerical stability of the learned parameters.
Questions for authors
-
What exactly is being predicted by the proposed “self-prediction” mechanism? Since the formulation does not explicitly predict a future quantity or optimize a prediction error, why should it be interpreted as predictive coding rather than as an auxiliary recurrent/adaptive state?
-
Could the authors compare against a simple capacity-matched baseline that adds an additional leaky input-memory state but does not include spike feedback? This would help determine whether the gains come from the proposed input-output residual or simply from adding another recurrent state.
-
In the feedback-path ablations, input-memory-only is already strong, and full feedback can even underperform input-memory-only depending on the architecture. Can the authors clarify what empirical evidence demonstrates that the spike-feedback term is an essential part of the method?
-
The broader learn- experiments improve 11 of 20 configurations and degrade 9, with a very small mean gain. How should this result be reconciled with the claim that learning the spike-feedback strength generally improves performance?
-
Could the authors provide direct comparisons with representative adaptive/recurrent neuron models, such as ALIF/adLIF, TC-LIF, TS-LIF, STC, or other comparable auxiliary-state neuron models, under the same backbone and training setting?
-
Some learned coefficients become extremely large while the corresponding memory-update coefficient becomes very small. Does the model have a scale-identifiability issue between and ? Would directly parameterizing the effective quantity be more stable and interpretable?
-
Could the authors report runtime and memory overhead introduced by the additional recurrent state during training and inference?
Mechanistic Framing, Capacity-Matched Controls, and Conditioning
Thank you for your structured review, insightful questions, and recognition of our broad evaluation and diagnostic ablations. Your feedback directly helps us sharpen our terminology, highlight our capacity-matched controls, and clarify parameter conditioning.
1. Reframing "self-prediction" We agree that mpl[t] does not explicitly predict future stimuli or optimize a prediction-error loss; rather, it modulates membrane integration using an exponentially weighted trace of input drive minus emitted spikes: Il[t]=xl−1[t]+mpl[t−1], mpl[t]=(1−τpl)mpl[t−1]+τpl(alxl−1[t]−blsl[t]). In the revision, we will clarify that "self-prediction" serves as an intuitive label for this history-dependent anticipatory drive, while framing the mechanism rigorously as neuron-local input-output memory with subtractive feedback.
2. Capacity-matched baseline in Table 9 Table 9's "Input memory only" variant (mpl[t]=(1−τpl)mpl[t−1]+τplxl−1[t], added to Il[t]) serves as this exact capacity-matched baseline. Verified in our implementation, it disables only the spike-feedback term while retaining the identical auxiliary state dimension and learnable τpl parameter count as fixed full feedback, achieving Last-5 accuracies of 94.998% (SEW ResNet-18) and 94.798% (Spiking ResNet-18).
3. Complementary roles of input memory and spike feedback Comparing full feedback against capacity-matched input-only memory yields Last-5 accuracies of 95.170% (+0.172 pp) on SEW ResNet-18 and 94.572% (-0.226 pp) on Spiking ResNet-18. Together with our single-neuron and sequence analyses, this cleanly disentangles two complementary functions: input memory supplies persistent drive for accuracy gains, whereas subtractive spike feedback acts as a homeostatic regulator—curbing strong-input firing from 19 spikes back to 10 spikes in Fig. 2, eliminating post-stimulus firing across 36/36 settings in Fig. 12, and enabling long-horizon credit assignment on Sequential CIFAR-10 (Table 3).
4. Positioning fixed rules vs. learnable bl We appreciate this point. While learning bl improves LIF accuracy in Table 5 (+0.22/+0.33 pp Best; +0.118/+0.420 pp Last-5), the broader 20-configuration sweep in Table 10 shows 11 gains and 9 losses (mean +0.0465 pp). Accordingly, we will position the tuning-free fixed reference rule (al=1,bl=τl) as our primary recommended method and present learnable bl as architecture-dependent adaptation, while flagging historical comparisons and single-run observations (including ImageNet-1K's +0.20 pp).
5. Comparison with related adaptive/recurrent neurons Thank you for highlighting ALIF/adLIF, TC-LIF, TS-LIF, and STC. We will expand Section 2 to systematically contrast state dimensions, driving signals, and feedback injection points—highlighting how our state couples pre-synaptic input current with output spikes while preserving base membrane/reset mechanics. Controlled benchmarks under matched backbones, time steps, and training budgets (reporting both accuracy and overhead) are outlined as an immediate follow-up study.
6. Parameter conditioning and effective step size Defining κl=τplbl rewrites the update as mpl[t]=(1−τpl)mpl[t−1]+τplalxl−1[t]−κlsl[t]. Thus, even when bl≈86201.5 is paired with τpl≈1.13×10−4, the immediate spike-triggered decrement remains bounded at κl≈9.756. Because τpl also governs memory retention (1−τpl), this is not exact global scale non-identifiability, yet extreme pairs indicate ill-conditioning; we will discuss directly parameterizing κl in Appendix F.3 as a cleaner, well-conditioned alternative.
7. Analytical vs. empirical system footprint Storing one auxiliary scalar state per neuron requires 4N bytes of persistent FP32 memory for N neurons, alongside elementwise updates per step and BPTT intermediate storage. We will clarify in the revision that this represents an analytical complexity bound rather than empirical profiling, noting that wall-clock latency, peak GPU memory, and SOPs depend on implementation, batch size, and T, and warrant dedicated benchmarking.