- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DISSENT, a randomized defense against query-based adversarial attacks to lower down the effectiveness of adversarial example crafted against the mean predictor thorough EOT. The method uses lora adapters and cross-vulnerability training to encourage agreement on clean input and reduce adversarial transferability. The method is evaluated on CIFAR-10 and ImageNet against various attack methods and compared with many defense strategies.
Critical strengths
- The motivation for mitigating EOT-based attacks by distinguishing between recovering the mean prediction and achieving reliable adversarial transfer is insightful, and the proposed cross-vulnerability training directly addresses this problem.
- The evaluation is very comprehensive. The paper evaluates multiple adaptive attacks and provides extensive ablation studies supporting the effectiveness of learned disagreement across adapters. The comparison with other defenses also highlights the advantages of the proposed method over existing baselines.
Critical weaknesses
- Although the paper evaluates the inference latency and storage overhead, it doesn't quantify the training cost of generating adversarial examples and optimizing across sampled predictors. A fair comparison with conventional adversarial training under the same computational budgets would help establish whether the additional complexity is need. 2.The evaluation focuses on conventional image classifiers and dataset, while modern vision-language models increasingly support more complex, and the adversarial attacks have evolved to question-answering scenarios such as jailbreak or prompt injection. It is unclear how useful and how much overhead cost would the proposed method introduce. This limits the applicability of the proposed framework.
Questions for authors
- Could the author report the training FLOPs or GPU-hours of DISSENT and other defenses or compare their effectiveness under matched computational budgets?
- How could the proposed method be extended to vision-language models, particularly open-ended visual question answering tasks?