- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Robust Expert Collaboration (REC), a replay-free framework for adversarial task-incremental continual learning. REC separates robust task-expert construction from shared-backbone integration, using Diversified Multi-Expert Learning (DMEL), Robust Anchoring and Stability Cooperation (RASC), and a Class-wise Robust Constraint (CRC) for validation-based checkpoint selection. Experiments on Split CIFAR-10 and Split CIFAR-100 with a CLIP-pretrained ViT-B/16 backbone evaluate clean and adversarial accuracy under FGSM, PGD-Linf, PGD-L2, and BIM, showing a favorable robustness–retention trade-off.
Critical strengths
A main strength is that the method addresses both adversarial robustness and catastrophic forgetting within a unified continual-learning framework, rather than optimizing only one.
The design is also supported by component-wise ablations; for example, on Split CIFAR-10, the full configuration achieves 95.05% clean accuracy and 79.32% average adversarial accuracy, demonstrating that the proposed components meaningfully contribute to robustness while preserving clean performance.
Critical weaknesses
The experimental evaluation is limited to Split CIFAR-10 and Split CIFAR-100, both image-classification benchmarks. This makes it difficult to judge how well REC generalizes to larger-scale datasets, different domains, or more challenging continual-learning settings.
The evaluation uses a task-incremental, task-aware setting with a single CLIP-pretrained ViT-B/16 backbone. It would strengthen the paper to evaluate whether the conclusions remain valid under other continual-learning settings, particularly class-incremental learning, and with different backbone architectures.
Questions for authors
Please follow the strengths and weaknesses.
The experimental evaluation is limited to Split CIFAR-10 and Split CIFAR-100, both image-classification benchmarks. This makes it difficult to judge how well REC generalizes to larger-scale datasets, different domains, or more challenging continual-learning settings.
The evaluation uses a task-incremental, task-aware setting with a single CLIP-pretrained ViT-B/16 backbone. It would strengthen the paper to evaluate whether the conclusions remain valid in other continual learning settings, particularly class-incremental learning, and across different backbone architectures.
Response to Reviewer i2JZ
We thank you for suggesting broader dataset evaluation and for asking whether REC can operate without a task ID or with another backbone. We address these points with the following results.
Q1. Can REC be evaluated beyond CIFAR?
A1. Thank you for this suggestion. We chose TinyImageNet because its ImageNet-derived object categories provide a different image source and a broader class set than CIFAR-10 [1], directly addressing your request for evidence beyond CIFAR. Under the same Task-IL backbone, class split, and attack evaluation for both methods over 100 seen classes, REC and the controlled FLAIR-style adaptation obtain:
REC is higher on all six reported metrics, including +0.78 pp Clean, +1.38 pp PGD-ℓ∞-10, and +1.21 pp RobustAvg. We will add this matched comparison to the main results table and briefly specify its protocol in Section 4 of the revised manuscript.
Q2. Can REC operate without a task ID or use another backbone?
A2. Thank you for this proposal. REC also performs better in a task-agnostic inference audit. We combine the Task-IL-trained experts into a ten-class predictor and attack its global output without providing a task ID:
REC exceeds USP-FSR-AT by +1.47 pp Clean and +2.02 pp PGD-10 under joint prediction. Both methods score below their task-aware Task-IL results, reflecting the harder no-task-ID setting. This is an inference extension, not Class-IL-specific training; all reported runs still use CLIP ViT-B/16. We will clarify the audit protocol in Appendix F and this scope in the Limitations.
[1] H. Pouransari and S. Ghili, Tiny ImageNet Visual Recognition Challenge, Stanford CS231n report, 2015.