- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes a sleep-inspired framework for continual learning in spiking neural networks. Daytime learning combines source-dependent replay, old-class distillation, and classifier-weight regularization controlled by detached neuronal statistics. Nighttime learning consolidates knowledge through approximately class-balanced memory replay and distillation. Experiments cover MNIST, DVS128 Gesture, CIFAR-10, and CIFAR-100 under class-incremental and task-incremental settings, using a fixed memory capacity of 500 samples.
Critical strengths
The paper addresses the important problem of catastrophic forgetting in spiking neural networks. Its sleep-inspired separation of adaptation and consolidation provides an intuitive framework for managing the stability–plasticity trade-off, making the research direction relevant to both continual learning and brain-inspired computing.
Critical weaknesses
-
The principal comparisons do not isolate the effect of the proposed learning algorithm. Section 4.1 uses artificial neural networks for the MNIST and CIFAR baselines but different spiking architectures for the proposed method; the DVS128 Gesture architecture is also described as “improved.” Consequently, the sequential curves described as matched comparisons still confound learning strategy with architecture and potentially optimization. The heterogeneous protocols acknowledged for Tables 1–2 further limit comparative conclusions. Evaluation against ER, DER++, and relevant SNN baselines using the same architecture, memory policy, augmentation, and comparable training budgets is necessary to substantiate the main performance claims.
-
The controller’s objective may encourage boundary-seeking behavior rather than meaningful sample-dependent adaptation. In Section 3.2, detached neuronal statistics produce coefficients whose minibatch mean enters only the regularization objective. For fixed classifier weights, this objective is linear in the mean coefficient, so its preferred value lies toward one of the permitted extremes unless the two penalties balance exactly. Furthermore, every sample receives the same sign of direct coefficient gradient, determined by global classifier-weight drift, while the controller receives no direct classification or distillation supervision. This does not establish that useful sample-specific plasticity is learned.
Questions for authors
-
The method simultaneously introduces a controller, selective weight anchoring, source-dependent Mixup, label smoothing, distillation, balanced replay, and an additional consolidation stage. Without controlled ablations, the observed improvements could arise primarily from familiar replay or distillation components. Particularly informative comparisons would remove each major component and compare nighttime consolidation with the same number of balanced replay updates interleaved throughout daytime learning.
-
The state vector combines membrane-potential statistics and spike rate, which have different scales, yet their relative scaling before cosine-distance computation is not explained. Min–max normalization also makes surprise depend on minibatch composition and can amplify very small differences. Moreover, classifier expansion changes the population over which these statistics are aggregated, potentially introducing changes unrelated to forgetting. Sensitivity analyses and measurements relating surprise to subsequent forgetting would help establish whether the signal captures meaningful novelty.
-
The experimental description is insufficient for reproduction. The manuscript should specify the exact “improved” architectures, neuronal leak and reset settings, event preprocessing, exemplar selection and removal rules, replay batch sizes, controller optimization, and learning-rate schedules. Nighttime epoch counts are stated for CIFAR but remain unclear for MNIST and DVS128 Gesture.
-
The scope of the SNN-specific contribution should be clarified. Section 3.1 states that the feature extractor is evaluated once and only the spiking classification head is unfolded over time. The manuscript should therefore describe the architecture precisely and distinguish benefits attributable to spiking dynamics from those attributable to the training schedule. A corresponding nonspiking-head control would be especially informative.
-
Section 3.3 divides the batch-averaged soft cross-entropy by the number of old classes, but this loss does not generally grow linearly with class count. The normalization may therefore progressively weaken preservation as the task sequence grows. Additionally, matching distributions normalized only over old classes preserves their relative responses without directly controlling competition between old and new classes. Sensitivity experiments and old-versus-new class accuracy breakdowns would clarify how these choices affect retention and calibration.
2 comments
I appreciate the authors' responses and their clarifications. However, my main concerns remain insufficiently addressed. In particular, the lack of architecture-matched comparisons still makes it difficult to isolate the contribution of the proposed learning strategy. I therefore maintain my original rating.
Authors' Response
Thank you very much for taking the time to review and for your support We try our best to address your questions as follows.
A1: The components are organized around acquisition and consolidation goals, not as isolated innovations. Source-related processing distinguishes current samples from past memories, while the controller modulates daytime retention intensity; nighttime switches to balanced memory consolidation. This functional division is directly verifiable via Eqs. (5)–(10). Controls address distinct issues: source-symmetric processing tests discrimination; fixed/global coefficients test input conditioning; ER with identical distillation tests routine retention; equal-budget interleaving tests temporal organization. State modulation and weight retention are separable (fixed coefficients still retain anchors). Interleaved updates act on acquisition-stage models and require redefining memory entry timing, thus not equivalent to post-acquisition consolidation. We will clarify these conditions and separate existing-system results from individual component effects.
A2: "Surprise" denotes a neuron's deviation from the consolidated reference state (Eqs. 2–4, Sec. 3.2); it does not represent semantic novelty or forgetting probability. Membrane potential mean/dispersion and firing rate provide complementary activity information; cosine distance removes uniform scaling, and min-max normalizes range. These operations serve distinct purposes—cosine does not eliminate component-wise scale differences, and normalization differs from pre-scaling. Batch composition, narrow distance ranges, and head expansion may influence this metric. We treat surprise as an auxiliary input in a bounded controller, combined with raw state, rather than sole determinant of predictions or forgetting. We will clarify statistical units, stability terms, and reference update rules; Sec. 3.3 explains reference updates via equilibrium memory statistics (momentum 0.9).
A3: Sections 3.1–3.3 and 4.1 describe the memory/head configuration, controller architecture, stage objectives, and CIFAR training settings. The revision and supplementary materials will further detail layer architecture, LIF dynamics, event preprocessing, memory management, replay, controller optimization, learning-rate scheduling, and night rounds. We will also release the full implementation and reproduction instructions (data splits, seeds, scripts, result aggregation), while including all necessary settings in the paper/supplement so that reproduction does not depend on future code releases.
A4: Section 3.1 describes a feature extractor that performs a single computation and a classification head that executes 12 steps. Phase scheduling, replay, and distillation are not unique to SNNs; what is directly related to SNNs is the dynamics of the classification head and the interface between membrane potential and firing rate states. In the spiking architecture studied in this paper, observable membrane potentials and firing rates are used to link neural dynamics and training regulation, which constitutes its SNN-specific implementation. The training scheduling is portable and does not require that each optimization tool be applicable only to SNNs. Non-spiking head controls allow for further analysis of the additional effects of spiking dynamics; we will clearly define the architectural scope of our findings, avoiding confusion between mechanism portability and SNN-specific effects, and refraining from drawing conclusions about hardware energy efficiency based on these results.
A5: Dividing by the number of old classes may indeed weaken long-sequence retention; we will correct the original paper's overly strong motivation. Contextually, Eq. (8) preserves intra-old-class relative responses, while daytime full-class supervision and nighttime class-balanced hard-label training provide direct old-new competition. Thus, softmax translation invariance within old classes does not imply a lack of cross-class competition in the full objective. Our method outperforms ER on Class-IL/Task-IL benchmarks, showing current weights function effectively under existing conditions. However, overall accuracy/forgetting does not equal a dedicated calibration test; we limit our claims accordingly and will investigate weight sensitivity and old-new performance on longer sequences in future work.