- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper points out that prior concept erasure methods are still vulnerable to image probes and proposes Image Probe Erase (IPErase), a two-stage concept erasure method relying solely on image conditions. In the first stage, IPErase constructs concept-contained and concept-removed image pairs using external pre-trained models, such as image inpainting and segmentation models. Then, for each pair, it samples along the DDIM trajectory using a pre-trained diffusion model and applies negative CFG to construct an erasure target that moves away from the concept-contained image toward the concept-removed image. In the second stage, the student is conditioned on the concept-contained image features and trained to predict the erasure target. Experiments on nudity and Van Gogh-style erasure demonstrate that IPErase is effective against image probes and performs well against adversarial text probes.
Critical strengths
- The paper shows that image-conditioned difference exhibits clearer target concept structures than the text-conditioned difference, motivating the proposed IPErase method.
- IPErase is effective against image probes and achieves performance comparable to adversarially trained SOTA methods against adversarial text probes.
Critical weaknesses
- Experiments are conducted on Van Gogh style and nudity only, which makes it difficult to evaluate IPErase’s generalizability. Prior works evaluate more diverse concepts. For example, AdvUnlearn covers artistic styles, nudity, and 4 objects. UCE evaluates object erasure on 10 objects.
- The baselines compared in the experiments are outdated. Co-Erasing [ICML’25] is the only relatively recent baseline, while newer methods, such as SPEED [A1] and CASteer [A2], are not compared.
- Since the model still accepts text prompts after erasure, quantitative evaluations on normal and paraphrased text prompts are necessary. For example, can the model still generate nudity from prompts such as "a man not wearing any clothes," "a naked woman," or "a lady that has no clothes on" after erasure?
- The evaluation in Table 3 is unclear.
- The data used to evaluate non-target preservation is unspecified. For example, UCE evaluates preservation on the remaining 9 objects when erasing 1 of 10 objects. MACE [A3] and Receler [A4] use MS-COCO 30K prompts to evaluate the non-target preservation for nudity erasure.
- Preservation results should be reported for all 5 configurations rather than simply indicating that they pass a threshold.
- In addition, comparisons with other erasure methods are missing, making it difficult to assess IPErase's non-target preservation performance.
- The sensitivity analyses of the number of image pairs and DDIM steps per pair on erasure performance are not shown.
[A1] SPEED: Scalable, Precise, and Efficient Concept Erasure for Diffusion Models. Ouxiang Li et al. ICLR 2026.
[A2] CASteer: Cross-Attention Steering for Controllable Concept Erasure. Tatiana Gaintseva et al. ICLR 2026.
[A3] MACE: Mass Concept Erasure in Diffusion Models. Shilin Lu et al. CVPR 2024.
[A4] Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers. Chi-Pin Huang et al. ECCV 2024.
Questions for authors
- How long does it take to generate 50 image pairs and perform 50 DDIM steps per pair for each target concept? Does image pair construction require human judgment, like filtering out unnatural images generated by the inpainting model?
- In Section 3.1, the paper shows that image-conditioned differences are more apparent than text-conditioned differences for nudity. Does this observation also hold for Van Gogh style, which is a more abstract concept?
- In line 215, the paper says that is used in the teacher model's updates. However, since moves the generation toward the target concept, why should the teacher generate target concept images?
- How does erasure performance change when the number of image pairs is reduced to 25 or 10, or when the number of DDIM steps per pair is reduced to 20?
Dear Reviewers,
The authors have posted their rebuttal. Please review their responses and the comments from your fellow reviewers, and provide any further feedback. Thank you.
The AC