- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
AdaLMM is a task-boundary model-merging procedure for replay-based class-incremental learning. It aligns a historical checkpoint to the updated model using activation-based matching and architecture-compatible transformations, then learns an interpolation coefficient for each layer or block by minimizing replay loss. BatchNorm statistics are recalibrated before the merged model is used for inference and later tasks. Experiments combine the procedure with ER, DER++, and ER-ACE on sequential CIFAR-100 and Tiny-ImageNet, using ResNet-18 and a pretrained DeiT backbone.
Critical strengths
- The strongest results show a meaningful benefit, especially with the pretrained backbone. In Table 2, AdaLMM improves over CLeWI from 85.29% to 86.40% on CIFAR-100 and from 81.41% to 83.94% on Tiny-ImageNet at the 60% budget, with small reported run-to-run deviations. Table 1 also shows useful improvements over replay on Tiny-ImageNet. Five seeds, architectural diversity, and explicit checkpoint accounting are valuable features of the evaluation.
Critical weaknesses
- The evidence for the specific layer-wise contribution is weaker than the evidence for merging overall. In Table 3, replacing a learned global coefficient with layer-wise coefficients improves mean accuracy by 0.21 and 0.27 points on CIFAR-100 and by 0.45 and 0.43 points on Tiny-ImageNet. These differences consistently favor AdaLMM, but five-seed summary statistics alone do not establish how reliable or practically meaningful each advantage is. The same component ablation is not supplied for the pretrained backbone, where the main results are strongest.
- The protocol leaves uncertainty about the proposed explanation and comparison advantage. The motivation is a plasticity plateau, yet the main metrics are final average accuracy and forgetting. Those metrics do not distinguish improved learning of the newest task from preservation of earlier tasks; recent-task accuracy before and after merging would address that distinction.
Questions for authors
- Can you report paired differences across seeds for layer-wise versus learned global coefficients, and repeat the component ablation for DeiT? Which component explains the largest gains in Table 2?
- Was CLeWI's scalar coefficient retuned for the abundant-memory settings with a comparable selection budget? How does that affect the comparison?
- What is each method's exact persistent-memory budget for DeiT, including historical checkpoints? Does the comparison remain favorable if replay images are stored compactly?
2 comments
Follow-up on Our Rebuttal
Dear Reviewer X3Cq,
Thank you for taking the time to review our paper and provide valuable feedback. As the discussion period is nearing its conclusion, we would like to kindly follow up on our earlier rebuttal and the additional experimental results.
We would appreciate knowing whether our responses have adequately addressed your concerns. If you have any remaining questions or suggestions, we would be happy to clarify them.
Best regards,
The Authors of Submission 47323
Response to Reviewer X3Cq
Thank you for the questions about Table 2.
1. How much do block-wise coefficients add?
On DeiT-S/16 at 60% replay capacity, we fitted either one global coefficient or 15 block-wise coefficients at each merge, using the same fitting budget. We report all six configurations (mean ± sample SD, seeds 42–46).
The table gives the block-wise minus global accuracy difference for each seed with alignment on (pp).
On Tiny-ImageNet, block-wise fitting showed the larger gain (+0.95 pp without alignment and +1.06 with it). Alignment added 0.41 pp with a global coefficient and 0.52 with block-wise coefficients. For the original ResNet runs (Table 3), only the mean gains at 60%/80% are verified (+0.21/+0.27 pp on CIFAR-100 and +0.45/+0.43 on Tiny-ImageNet).
2. How does retuning CLeWI affect the comparison?
Table 2 used the published ER setting (α = 0.3). At 60% capacity, we retuned CLeWI using 10 development runs across the two datasets. We selected α using validation data held out from training, then fixed it for all five test seeds. The external search was for CLeWI only. AdaLMM fits its coefficients on replay at each boundary. We report every fixed α tested on the five seeds (test mean ± SD).
Compared with the selected CLeWI settings, AdaLMM's mean accuracy was 1.136 pp higher on CIFAR-100 and 2.468 pp higher on Tiny-ImageNet. On Tiny-ImageNet, changing α from 0.3 to 0.5 reduced mean forgetting by 0.031 pp and changed test accuracy by +0.01 pp. Retuning alone does not explain the smaller accuracy gaps here.
3. DeiT memory budgets and accuracy with compact replay
Table 2 already uses compact replay. All three methods store native-resolution uint8 images and use the full replay capacity shown below. CLeWI and AdaLMM each store one additional historical checkpoint without reducing the buffer. ER stores no historical checkpoint.
These are exact persistent bytes beyond the current model, including replay, historical weights and merge coefficients. Including the current model adds 86,816,656 bytes to each CIFAR-100 entry and 86,970,656 bytes to each Tiny-ImageNet entry.
Compared with CLeWI, AdaLMM uses only 56 additional bytes. With compact replay and CLeWI's retuned coefficient at 60% capacity, mean accuracy was nearly identical on CIFAR-100 (86.278% vs. 86.264%) and slightly higher for AdaLMM on Tiny-ImageNet (83.760% vs. 83.442%).
Compared with ER, AdaLMM uses more memory at the same replay capacity. Table 2 nevertheless gives one comparison in which AdaLMM achieved higher accuracy with less storage. On Tiny-ImageNet, AdaLMM with 60,000 examples reached 83.94%, versus 80.28% for ER with 80,000 examples, a gain of 3.66 points using 159.11 MB less. Accuracy at exactly matched total-byte budgets has not been measured.