- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper makes three major contributions. First an adversarial detection setup is proposed in the form of a hybrid selective-prediction framework. From my understanding a disagreement between the student and the teacher serves as a detection rule (and the best result). Second empirical results are shown on CIFAR-10, GTSRB and MNIST. Third, an explanation for bounds on the method is given.
Critical strengths
I like that the authors used a wide range of datasets including CIFAR-10, GTSRB and Tiny-ImageNet. Experimentally I think the results are satisfactory.
Critical weaknesses
There are two major issues that I can see with the current work.
Issue #1: Discussion of relevant literature. When I was reading through, I had a feeling I had seen a similar concept proposed in a lot of papers that you have not cited or discussed in relation to your work.
A) Disagreement between models as a form of detection adversarial examples was proposed in the Barrier Zone paper:
https://ieeexplore.ieee.org/abstract/document/9663375
Model disagreement was further used as a detection method for ensembles in a game theoretic based adversarial defense here: https://ieeexplore.ieee.org/document/11155075
B) Architecture diversity as a form of KD adversarial training: https://www.sciencedirect.com/science/article/pii/S1877050925021647
To be clear I am NOT claiming your method is not novel. But I would like to see a discussion and citations for how your method is built on top of what appears to be earlier methods in the literature that are not properly cited.
Issue #2: Experimental problems. I do not want to see FGSM or PGD results in a paper that has AA. FGSM and PGD are older algorithms and it is well established in the literature that APGD (from AA) outperforms it in most cases. I can dig out appropriate citations to back up my claim if needed but really this should just be common knowledge at this point. I suggest the following: report AGPD in each table INSTEAD OF PGD. Move all FGSM and PGD results to the appendix. Still report AA because it is a great combination of attacks and may do even better than APGD in some strange cases.
(minor) Issue #3: AA does include a black-box attack (square), but I would be curious what a true hard label black-box attack results might achieve. E.g. RayS or ADBA:
Rays: https://arxiv.org/abs/2006.12792
ADBA: https://arxiv.org/abs/2406.04998
As a reviewer I CANNOT mandate you do anymore experiments. I think the set of attacks you did is OK. I would just like to mention it would definitely make it easier for me to argue in favor of acceptance with other reviewers if the entire suite (white-box and SOTA black-box attacks were included).
Other minor comment: Is it possible for you to report w-robust for each model configuration to make it very clear which configuration performs best? You can find the w-robust metric used in other top tier papers like this one: https://www.ecva.net/papers/eccv_2022/papers_ECCV/papers/136640577.pdf
Questions for authors
-
Is it possible for you to improve the writing by discussion and citing proper foundational works in this domain?
-
Is it possible for you to improve the experimental discussion by removing non-SOTA white-box attacks and/or reporting w-robust?
We sincerely thank the reviewer for their constructive feedback. We have provided additional experimental evidence addressing the main concerns. We hope these additions help clarify the contribution and its limitations. We would greatly appreciate any further feedback, particularly on whether our new experiments and explanations adequately address your concerns. We are happy to clarify any remaining questions.