- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DiSCO, a training-free, black-box defense against unsafe text-to-image generation. It addresses the benign adversarial problem, where seemingly safe prompts trigger harmful outputs, through distribution-guided contrastive suffix optimization. Experiments demonstrate that DiSCO effectively reduces attack success rates while maintaining generation quality, offering a practical and scalable defense for text-to-image models without requiring access to model internals.
Critical strengths
- The authors propose a plug-and-play defense that can suppress NSFW image generation by T2I models in black-box settings.
- The authors extensively evaluate the impact of hyperparameters and the trade-off between efficiency and performance, achieving impressive results on the evaluation set.
Critical weaknesses
-
The threat model is unclear. In Section 3.2, the authors state that DISCIO is triggered only by benign adversarial samples, which seems to assume that the defender can determine whether the original generated image is harmful. However, if the defender can identify harmful images in advance, directly rejecting their generation would be a more straightforward approach than modifying the prompt. In addition, it is unclear whether the attacker's malicious concepts must be included in the reference set, leaving the defense's ability to handle unseen malicious concepts uncertain.
-
Although the authors evaluate semantic drift, the optimization objective remains incomplete and may admit trivial solutions that have not been identified. Specifically, Equation 4 does not constrain the semantic deviation introduced by the added suffix. Ideally, the suffix should guide the generative model to remove potentially malicious concepts while preserving the benign content of the original prompt.
Questions for authors
Does DISCIO assume that the defender can identify harmful generated images in advance, and can it handle unseen malicious concepts that are not included in the reference set?