- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors investigate the opposite of adversarial attacks: a large, clearly visible disturbance that causes the model to retain its original, correct prediction, even though a human would no longer be able to recognize the image. They then answer three questions: whether humans actually perform worse than the model, whether common tools for detecting and calibrating out-of-distribution (OOD) data can detect this, and whether existing defense methods can mitigate this. The authors conduct various tests on three datasets.
Critical strengths
- The authors carry out many experiments. I also find the tests involving humans, as compared to models, interesting.
Critical weaknesses
-
The paper is not well written or easy to understand. The abstract does not effectively introduce the topic and provides too many details right from the start (footnotes and references are also not useful there). The introduction really lacks an introduction to the topic as well as an explanation of the motivation behind the various steps of the method/experiments (right at the beginning, readers are presented with a formula without any explanation of the notation). Phrases such as “It does not, , and 4) Verify,” as well as the constant references to later sections, do not make for smooth reading. Section 3 is titled “Methods,” but seems to be more of an experimental setting. Various abbreviations, such as NKE, NI-FGM, etc., are used but not defined. The citations for datasets and networks are missing. Note, some tables extend beyond the edge.
-
The novelty and timeliness of the approach seems unclear to me. The idea comes from the paper by Nguyen et al. (2015), what appears to be new is its application to ImageNet and a few other tests. The context, i.e., what the question is, what the task is, is not clear. Several aspects are being investigated, such as the distinguishability between humans and models, what appears appropriate, and shape/texture biases. On the other hand, tests are also being conducted using OOD methods, as well as adversarial-robust models and randomized smoothing, which are still unclear. Moreover, it feels like an outdated related work section (with the most recent source from 2019) from papers that has something to do with the topic being presented. For example, there are many newer OOD and randomized smoothing methods than those used in the paper.
Questions for authors
- Are there any more recent works in this field or methods that have been applied? The most recent source is from 2022.
- What is new in this study compared to the paper by Nguyen et al. (2015)?
- I find the OOD definition vague, since it is still the same input image but with noise. So at what point should an OOD detection method classify the image as an OOD?
- The idea behind adversarial training is that the models are more robust and do not change their predictions, but that is exactly what they are doing. Could you explain this point in more detail?
- In Table 1, what are Models A and B?