- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents DDAttack - a score-based black box adversarial attack on image classifiers that uses dataset distillation to guide the initialization and the procedure of searching adversarial examples. The authors argue that the class-information available in distilled examples helps to determine better search detection which results in higher attack success and better query efficiency. They support their claim with experiments on ImageNet across several robust models and compare their results to existing score-based black box attacks. They also study the dependence on the distillation approach and the hyperparameters of their method.
Critical strengths
-
Up to my knowledge usage of data distillation for black box adversarial attacks is a novel direction relevant for the community. The paper is clearly written.
-
The paper supports its claims with a broad set of experiments on multiple robust models. The improvement appears to be consistent even if it is not big. The authors provide a reproducibility statement and share the code for experiments.
Critical weaknesses
-
The main concern is that proposed method relies on having a distilled dataset which is a strong requirement. Besides that, DDAttack borrows significant parts of its update structure from the Square Attack (Section 3.3). Despite the factors of a significantly stronger requirement and an overlap with the Square Attack method, the success rate improvement on top of Square Attack which is demonstrated in the Tables 1 and 2 is quite moderate and is mostly below 2 percent points. Therefore, even though the improvement is rather consistent, the value for the black-box robustness evaluation field appears to be limited.
-
The evaluation is limited. It only experiments with the transformer-based architecture (ViT, Swin). Experiments with CNNs would be valuable especially given that the square-form of the Square Attack update was shown to exploit the CNN filter structures and its performance might be better there. Also the paper is considering only untargeted attacks and only in the setting. Targeted attacks and setting are not considered.
-
The method uses multiple hyperparameters in the initialization and search algorithms. Even though the Appendix presents multiple ablation studies experiments, the authors acknowledge that the number of competing classes has significant impact on the method efficiency (lines 787 - 795 in the Appendix B). Therefore, it is unclear whether the method generalizes beyond ImageNet with the same hyperparameters or additional hyperparameter tuning is required.
Questions for authors
- Can DDAttack be adapted to the targeted attack setting i. e. perturbing the class to the specific targeted class, not any other class than the predicted one? It is much more challenging for ImageNet which has many classes than the untargeted setting which was considered in the paper.