- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes UniErase, a training-free concept erasure method for suppressing sexually explicit content generation in diffusion models, and UniErase-Bench, a benchmark for evaluating such methods. UniErase identifies concept-related channels in generation-side FFNs and applies a closed-form weight projection to remove the corresponding concept subspace from their outputs. Since the weights are modified offline, the method introduces no additional computation at inference time. UniErase-Bench covers four generation tasks spanning text-only and image-conditioned inputs, with image or video outputs.
Critical strengths
-
By using FFNs as an editing target, UniErase demonstrates applicability across diffusion models based on U-Nets and transformers, as well as across all four generation tasks.
-
In Table 1, UniErase achieves the highest average ER among the evaluated methods at 94.48%, including an ER of 82.70% against the white-box attack P4D. Its CLIP score and FID on benign generation also remain close to those of the original model, suggesting a favorable balance between concept erasure and preservation of generation quality.
Critical weaknesses
-
The benchmark’s novelty is limited, and its coverage of attack strategies falls short of the claimed “full attack surface.” Its text-only subsets reuse I2P for T2I and T2VSafetyBench for T2V, while MMA-Diffusion [4] already provides both text- and image-based attacks and associated evaluation data. Although UniErase-Bench extends evaluation across four generation tasks, it does not include systematic evaluation tracks for black-box, white-box, or adaptive attacks, particularly optimized adversarial prompts, images and joint text–image attacks. The adversarial experiments in Table 1 are separate T2I evaluations and do not extend the scope of the benchmark itself. The paper should more clearly demonstrate what additional evaluation value the newly constructed image-conditioned subsets and unified four-task evaluation provide over existing benchmarks.
-
The algorithmic distinction from prior work requires clearer explanation and validation. Training-free direct weight editing has already been explored in UCE [1]. Bae et al. [2] analyze cross-attention OV subspaces and remove concept-related spectral components, while CAD [3] selectively removes parameters based on concept attribution. The paper should more clearly establish how UniErase’s FFN channel localization and concept-subspace projection differ algorithmically from these approaches, and what additional benefits these design choices provide.
Questions for authors
-
Why does UniErase-Bench not include evaluations for black-box and white-box adversarial attacks?
-
Have you analyzed the roles that the FFN channels identified by UniErase and their corresponding weights play during generation? Do these components contribute specifically to sexually explicit content, or do they also support the generation of other concepts or visual attributes?
-
Have the authors conducted a failure case analysis? What are the main failure modes? Figure 7 also shows suppression of edits involving swimwear and shirtless men. What criteria are used to distinguish sexually explicit content from benign content? Has over-erasure been evaluated for benign concepts that are semantically or visually related to the target concept?
4 comments
Response to Reviewer JMY6 2/3
Q2 Roles of Concept-Relevant FFN Channels
As discussed in Section 4.3, the identified FFN channels are concept-relevant rather than concept-exclusive, as they may also encode benign visual attributes such as skin texture and human anatomy. Directly zeroing these channels would therefore risk removing valuable benign information. To address this, UniErase employs contrastive subspace refinement to selectively remove target-specific directions while preserving other semantic information within the same channels. Our component-level ablation in Table 1 further supports this design, showing that UniErase achieves better benign content preservation than direct channel zeroing while maintaining strong erasure effectiveness across both U-Net and DiT architectures.
Q3 Failure Cases and Adjacent Benign Concepts.
We thank the reviewer for raising the important concern and further clarify the scope of our concept-erasure criteria below.
(1) Failure case analysis. Our failure case analysis shows that while UniErase effectively suppresses text-induced explicit generation, residual failures are more concentrated in S3, where both textual and visual conditions introduce harmful concepts. Such dual-modal reinforcement makes concept erasure more challenging and requires broader intervention to achieve stronger suppression. As shown in Table 2, increasing the channel budget K substantially reduces residual ASR with minimal impact on reference-image similarity, whereas a larger λ achieves stronger suppression at a greater preservation cost.
Table 2: Sensitivity analysis of K and λ on FLUX.1-Kontext (S3).
| K | λ | ASR (%) ↓ | CLIP-I ↑ |
|---|---|---|---|
| 50 | 5 | 35.0 | 99.21 |
| 75 | 5 | 27.7 | 99.04 |
| 100 | 5 | 22.6 | 99.22 |
| 50 | 7 | 25.0 | 98.53 |
| 50 | 10 | 12.3 | 95.37 |
(2) Erasure criteria. Our current implementation treats substantial exposure of sensitive anatomical regions, including the chest, genitals, buttocks, and other intimate body areas, as nudity-related explicit content. This operational definition follows the broader evaluation settings adopted in prior concept-erasure research [1–4], ensuring consistency with existing studies.
(3) Adjacent benign concepts. UniErase employs contrastive subspace refinement to preserve benign visual attributes, such as skin texture and everyday clothing, including conventional swimwear and non-explicit underwear.
However, borderline cases such as the "revealing bikini" in Figure 7(b) may expose substantial portions of sensitive body areas, potentially causing distress and reputational harm to the depicted individual, thus motivating our intervention. Similarly, while classical nude sculptures and men with exposed upper bodies may carry different meanings across cultural contexts, our current implementation follows the adopted nudity-related criteria[3, 4] in treating such representations as targets for erasure.
[1] Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models, CVPR 2023
[2] Erasing Concepts from Diffusion Models, ICCV 2023
[3] Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models, ECCV 2024
[4] Sculpting Memory: Multi-Concept Forgetting in Diffusion Models via Dynamic Mask and Concept-Aware Optimization, ICCV 2025
Response to Reviewer JMY6 3/3
Our Question
We noticed that the review uses numbered citations [1]–[4], but the corresponding reference list is missing. We have identified the relevant works based on their descriptions and hope that our interpretations are correct. If any references have been misidentified or our understanding differs from the reviewer's intent, we would appreciate further clarification and will revise our discussion accordingly.
Reviewer interaction needed
Could the reviewer please react to the author's question and to their rebuttal? Kind regards, The AC
Response to Reviewer JMY6 1/3
W1 & Q1 Benchmark Scope and Novelty
We thank the reviewer for raising this concern and clarify that the "full attack surface" in our work refers to the four generation task categories defined by input conditioning and output modality, rather than exhaustive coverage of adversarial attack strategies.
Research scope. As also recognized by Reviewer WmXb, real-world misuse such as nudify applications and sextortion highlights the importance of image-conditioned and video generation. Motivated by the growing gap between this expanding threat surface and the T2I-centric focus of existing concept-erasure benchmarks, we introduce UniErase-Bench to provide a unified evaluation foundation for developing and validating our erasure framework. While MMA-Diffusion focuses on adversarial image perturbations in text-guided image editing to bypass post-hoc safety checkers, UniErase-Bench systematically covers four generation tasks and three complementary cross-modal attack scenarios, enabling comprehensive evaluation of risks arising from textual, visual, and joint conditioning.
Adversarial attacks. We agree that adversarial optimization of textual, visual, and joint inputs could yield stronger attacks and represents a promising research direction. However, developing systematic adversarial attacks across T→V, T+I→I, and T+I→V involves substantial task-specific challenges and warrants dedicated investigation. Therefore, in this work, we adopt existing black-box and white-box adversarial attacks to evaluate the robustness of UniErase. Building upon UniErase-Bench to explore adversarial attacks across these generation tasks is an important direction for our future work.
W2 Algorithmic Distinctions from Prior Work
We thank the reviewer for highlighting these relevant works. We acknowledge that our method draws inspiration from established techniques, including closed-form weight editing, concept attribution, and subspace-based concept removal. However, directly applying these techniques across heterogeneous diffusion architectures and generation tasks remains challenging. Our contribution lies not in simply combining existing techniques, but in carefully adapting and integrating them into a unified, selective concept-erasure framework. The key technical distinctions are as follows:
(1) Unified intervention space across architectures. UCE edits text-conditioned cross-attention weights, limiting its ability to address harmful concepts introduced through image conditioning, while Bae et al. focus on spectral analysis of cross-attention OV subspaces. In contrast, UniErase operates on generation-side FFNs, which process representations after conditioning information has been integrated, providing a shared intervention space across heterogeneous architectures and input modalities.
(2) Selective concept subspace editing. Unlike CAD, which directly ablates concept-attributed parameters, UniErase aims to preserve benign information entangled within concept-relevant FFN channels. Since FFNs lack directly accessible text-aligned concept directions, we develop contrastive subspace estimation to isolate target-specific directions from shared benign representations, enabling precise and selective weight editing.
Component-level ablation. To further demonstrate the significance of our key design choices, we conduct a component-level ablation on both SD-v1.4 and FLUX.1-dev using the adversarial RAB dataset. The results demonstrate that selective projection and contrastive refinement improve benign content preservation while maintaining strong erasure effectiveness.
Table 1: Component ablation on SD-v1.4 and FLUX.1-dev.