- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SHERLOC, a framework for inferring an attacker's knowledge, capabilities, and objectives from observed adversarial attacks. The authors formulate attacker inference as an inverse optimization problem and evaluate attack reconstruction, parameter recovery, and downstream defense on linear and polynomial models.
Critical strengths
- The goal of this paper is interesting how do we know the attack's ability is an important problem
- The distinction between attack reconstruction and attacker recovery provides an interesting perspective on adversarial forensics.
Critical weaknesses
-
Limited significance and practical value. The related work is insufficiently discussed, and the paper lacks a convincing real-world application scenario. The evaluation is limited to simple models, without considering modern deep learning models or LLMs, substantially limiting its significance.
-
Overly restrictive assumptions. The defender is assumed to know both the adversarial and original inputs, which is impractical in realistic settings. Moreover, the defender need know the attacker's parameterized form in advance.
-
Unclear methodology and insufficient experiments. The methodology is not clearly explained in the main text, and the experiments lack comprehensive comparisons with relevant existing methods and practical baselines.
Questions for authors
See weaknesses