- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how pretrained spiking Transformers can learn new classes while retaining previous knowledge. The backbone is frozen, while task-shared LoRA modules and channel-wise firing thresholds are updated. Distillation, parameter anchors, and nearest-class-mean classification are used to mitigate forgetting. The online variant updates teacher snapshots using loss- or representation-based triggers. Experiments cover several datasets and spiking backbones, showing benefits of joint adaptation in some multi-epoch class-incremental settings, while single-module variants perform better in single-pass online learning.
Critical strengths
The paper addresses a meaningful continual-adaptation problem. With the same QKFormer backbone, sLoTh reaches 77.10% on 20-task ImageNet-R, versus 75.26% for SD-LoRA (Table 3). Joint adaptation achieves 81.23% on CIFAR-100 CIL, versus 72.63% for LoRA-only, supporting component synergy in this setting.
Critical weaknesses
-
seLoRA uses a standard low-rank update; CL-LoRA already incorporates shared LoRA and distillation, while CATFormer studies threshold-based continual adaptation in spiking Transformers. Combining pretrained backbones, shared thresholds, and stabilization differs from these methods, but the existing components themselves should not be treated as new mechanisms. Please identify and validate the specific additions.
-
The matched-backbone CIL comparison is useful, but OCL lacks a frozen-backbone baseline using the same NCM classifier. The contributions of pretrained features, prototype classification, and adaptation are therefore unclear. Please compare no adaptation, standard shared LoRA, threshold-only adaptation, and the full method using the same checkpoint, inference procedure, and data-access budget.
-
On 100-task Tiny-ImageNet OCL, the full method achieves 42.90%, versus 65.12% for LoRA-only. The authors report this degradation, and the demonstrated CIL synergy should be recognized. Nevertheless, the evidence does not establish that both mechanisms are generally necessary for long task sequences. Please explain the difference under matched stabilization objectives and limit the claims accordingly.
-
Prototypes are described as being computed after a task or after training, although OCL lacks true task boundaries. The order of class registration and trigger-loss computation is also unclear. Please explain how class registration, loss-based triggering, and prototype accumulation operate in a single pass, how feature drift is handled, and all data accesses needed to verify the online protocol.
-
The loss-based and RT variants change both the backbone and the trainable blocks, preventing attribution to the detector. The TIL upper bound in Figure 3 also changes task information at inference, so its gap cannot be attributed solely to unavailable training boundaries. Please hold the backbone, adaptation modules, and inference over all seen classes fixed when comparing boundary information or detectors, and report evidence of detection quality.
Questions for authors
Please see the weaknesses above.