- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Even adversarially trained models can remain vulnerable to specific attacks. Further training to improve robustness against such an attack may, in turn, reduce performance on images and attacks the original model handled correctly. To address this problem, the paper proposes HoneyTeacher. The method first collects adversarial images using a honeypot, a model configured by the defender for attackers to interact with. It then compares the outputs of the original model with those of a model trained on the collected examples and assigns new teacher outputs to the images. A new model is trained on this additional data, allowing it to incorporate new knowledge into its predictions while retaining its original capabilities.
Critical strengths
It is interesting that the method uses the honeypot and feedback manipulation to obtain attack examples useful for repairing the original model, and incorporates estimated repair utility into the design of its responses.
Critical weaknesses
Overall, the experimental validation is insufficient.
-
CIFAR-10 is the only dataset used. The evaluation should include at least two datasets substantially larger than CIFAR-10.
-
ResNet-18 is the only model evaluated. The evaluation should include deeper CNNs and more recent architectures, such as WideResNet. It should also examine modern transformer-based predictors, such as Vision Transformers.
-
The evaluation considers only Square Attack and PGD with CE and DLR losses. A credible evaluation of an adversarial defense must include AutoAttack (Croce & Hein, 2020). Even if the paper aims to improve robustness against one particular attack, it should expand the set of target attacks to include each component of AutoAttack and examine how improving robustness against one component affects robustness against the others.
-
The comparisons in this study consist only of ablations of the proposed framework. The authors should compare it with existing methods that have similar goals. For example,
S. Dai et al., Adapting to Evolving Adversaries with Regularized Continual Robust Training (2025)
should be considered as a baseline, although its objective is not identical. RCAT, discussed in the related work, should also be compared with the knowledge integration component of the proposed method. In addition, straightforward baselines such as further adversarial training or adversarial fine-tuning using the target attack should be evaluated. These methods generate adversarial examples adaptively during training, unlike training on fixed adversarial images as in .
Questions for authors
I would like the authors to substantially expand the experimental evaluation to allow a more rigorous assessment of whether the proposed method outperforms existing approaches.