- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates the ''concept erasing'' problem in text-to-image generation models, aiming to suppress specific target concepts while preserving the model's general generation capabilities. The authors introduce On-Policy Distillation (OPD) for concept erasing: a ''teacher'' model is frozen after being trained via existing erasing methods, while a ''student'' model—initialized from the original pre-trained model—generates images using the target prompt. The student then aligns its outputs with the teacher's predictions for the same target prompt at the states it visits. OPD further improves the trade-off between target suppression and generation fidelity across various existing methods. Furthermore, the authors propose Anchor-Conditioned Policy Distillation (AC-OPD), which employs a specially pre-trained teacher. While the student generates images using the target prompt, AC-OPD conditions the teacher using a non-target ''anchor prompt'' and requires the student to match the teacher's anchor-conditioned output at the states it visits; the authors implement this supervision constraint during the early stages of the generation process. Experiments covering nudity suppression and IP-based character erasure demonstrate that AC-OPD effectively suppresses target concepts while better preserving text-image alignment and compositional generation capabilities. the method was validated on FLUX and Z-Image Turbo.
Critical strengths
-
The paper is generally clear and readable. The overall presentation is well organized, and the figures and tables help communicate the main idea and experimental findings effectively. Despite some terminology that could be clarified, the manuscript is overall easy to follow.
-
The proposed method is simple and easy to implement, and the paper provides rich ablations. The authors examine several important design choices, including on-policy versus off-policy supervision, anchor selection, supervision horizon, and adapted blocks, which helps clarify the behavior of the proposed method.
Critical weaknesses
-
The methodological novelty appears limited relative to the closest existing ingredients. The erased-teacher OPD formulation largely overlaps with the objective already present in FlowErase-OPD, while the main additional idea in AC-OPD is to replace the erased-teacher prediction with an anchor-conditioned prediction from the original model at the same student-visited state, which is not suprising. Since target-to-anchor distribution alignment is already the central principle, AC-OPD appears to be a relatively direct combination of anchor-based erasure and on-policy distillation. The paper does not provide sufficient theoretical evidence that this combination. This concern is compounded by the absence of a controlled comparison with FlowErase-OPD (or an appropriately adapted single-concept variant) under a matched experimental setting. As a result, I find it difficult to assess whether the contribution is sufficiently distinct from closely related existing methods.
-
The preservation evaluation is insufficient to substantiate the claimed erasure–retention trade-off. The paper evaluates retention using global metrics such as COCO text–image alignment and GenEval, but does not systematically evaluate semantically related non-target concepts. This omission is important for AC-OPD because the method explicitly redirects transitions toward anchor-conditioned predictions, which may induce suppression of neighboring concepts or anchor-specific semantic replacement.
Questions for authors
None. My main concerns are already described in the Critical Weaknesses section and do not hinge on clarification of the current manuscript.
4 comments
Official Response to Reviewer ZV5m (2/2)
[W2] Insufficient evaluation of related-concept preservation and risk of anchor-specific semantic replacement.
We recognize that general preservation metrics such as COCO and GenEval may not fully capture unintended degradation of concepts semantically related to the erased target. To address this concern, we conduct two additional evaluations of non-target concept preservation.
First, we evaluated cross-IP preservation using four non-target characters after erasing each of Pikachu, Snoopy, and SpongeBob, with 250 images per character (1,000 per erased target). As these characters belong to the semantic category of our anchor prompt ("A photo of a cartoon character"), this evaluation also examines whether anchor-conditioned supervision suppresses neighboring concepts.
Second, we evaluated related-concept preservation, following HUB's pinpoint-ness evaluation protocol, which assesses unintended erasure of non-target concepts close to the erased target in CLIP text-embedding space. We selected three semantically related WordNet concepts for each erased target based on CLIP text-embedding similarity (e.g., minion for Pikachu and sponge for SpongeBob) and generated 100 images per concept. In both evaluations, Qwen3.5-9B assessed concept presence, and retention was defined as the percentage of positive judgments.
For cross-IP preservation, each entry reports the target detection rate (%) / non-target retention rate (%).
| Erased target | FLUX.1-dev | EA | EraseFlow | EraseFlow + OPD | AC-OPD (Ours) |
|---|---|---|---|---|---|
| Pikachu | —/96.7 | 2.7/80.4 | 2.6/80.6 | 1.0/85.9 | 0.0/90.0 |
| Snoopy | —/96.1 | 0.0/90.1 | 0.0/86.4 | 0.0/93.1 | 0.0/95.0 |
| SpongeBob | —/95.7 | 0.0/87.3 | 0.0/78.3 | 0.0/86.0 | 0.0/90.5 |
| Average | —/96.2 | 0.9/85.9 | 0.9/81.8 | 0.3/88.3 | 0.0/91.8 |
Cross-IP Preservation. As shown in the table above, applying OPD to EraseFlow improves non-target character retention while reducing the target detection rate, demonstrating that OPD also benefits in-domain concept preservation beyond general generation quality. AC-OPD achieves the highest retention among the erasure methods (91.8%, compared with 96.2% for the original model), with zero target detections across all three settings.
For related-concept preservation, we report retention rates (%) and their changes relative to FLUX.1-dev in percentage points.
| Erased target | FLUX.1-dev | EA | EraseFlow | EraseFlow + OPD | AC-OPD (Ours) |
|---|---|---|---|---|---|
| Pikachu | 98.3 | 87.0(−11.3) | 56.7(−41.7) | 86.0(−12.3) | 91.7(−6.7) |
| Snoopy | 96.7 | 73.7(−23.0) | 73.0(−23.7) | 87.7(−9.0) | 92.7(−4.0) |
| SpongeBob | 91.3 | 39.3(−52.0) | 53.3(−38.0) | 68.0(−23.3) | 76.0(−15.3) |
| Average | 95.4 | 66.7(−28.8) | 61.0(−34.4) | 80.6(−14.9) | 86.8(−8.7) |
Related-Concept Preservation. Consistent with the cross-IP preservation results, applying OPD to EraseFlow substantially improves the retention of semantically related concepts (61.0% → 80.6%), suggesting that OPD also helps mitigate collateral erasure of neighboring concepts. AC-OPD achieves the highest average retention among the erasure methods (86.8%). Some degradation remains relative to the original model (−8.7 pp on average and −15.3 pp for SpongeBob), but it is smaller than for the compared methods in every setting.
Anchor-specific semantic replacement. Regarding the concern that redirecting transitions toward anchor-conditioned predictions may replace outputs with anchor content, Fig. 3 and Figs. 22–23 in Appendix B.2 of our paper show that AC-OPD outputs are not dominated by the anchor content: even with semantically distant object anchors, AC-OPD continues to generate human subjects with limited anchor-related visual features.
We have incorporated the cross-IP and related-concept preservation evaluations and their analysis into Section 5.5 of the revised manuscript.
Fine, I have no further concern. Although I view the innovation in this work as being more incremental in nature, the experiments are undeniably extensive. In my opinion, the paper meets the requirements for acceptance at ICLR, so I have raised my score : )
Dear Reviewer ZV5m,
We sincerely thank the reviewer for their positive feedback and for reconsidering their assessment of our work. We are pleased that our responses have addressed the reviewer’s concerns. We would be happy to answer any further questions.
Best regards,
The Authors
Official Response to Reviewer ZV5m (1/2)
Publication timeline. FlowErase-OPD was first released on arXiv on August 7, 2026, less than two months before the ICLR 2027 submission deadline, and, to our knowledge, has not yet appeared in a peer-reviewed venue. We therefore regard it as concurrent work, and it was already cited and distinguished from AC-OPD in the Related Work section of our submitted manuscript.
Methodological distinction from FlowErase-OPD. FlowErase-OPD focuses on multi-concept erasure by distilling multiple pretrained single-concept erased teachers into a unified LoRA. It additionally employs the frozen original model as an auxiliary retention teacher on general prompts and adaptively balances erasure and retention objectives.
In contrast, our work first investigates OPD as a post-training approach for individual erased models, demonstrating improvements in erasure effectiveness and generation retention across four erasure methods on FLUX.1-dev, and further demonstrating its applicability to Z-Image Turbo (Tables 1, 2, and 7 of our paper). Building on these findings, we introduce AC-OPD, which directly uses the original model's anchor-conditioned transitions as erasure supervision at target-conditioned student states, rather than relying on separately trained erased teachers. Thus, although both approaches employ OPD, they differ in their research objectives and the construction and role of their supervisory signals.
Controlled comparison. No official code or checkpoints for FlowErase-OPD are publicly available, so a matched experimental comparison is not possible at this time. The closest comparison available is already in our paper: the erased-teacher OPD students in Tables 1 and 2 represent single-teacher, single-concept OPD-based erasure without FlowErase-OPD's multi-teacher consolidation and retention teacher, and are trained and evaluated under the same setting as AC-OPD.
Without requiring any erased teacher, AC-OPD achieves comparable or stronger target suppression, including the lowest average Ring-A-Bell ASR (1.76%), UnlearnDiffAtk ASR (19.35%), and average IP detection count (0.60), while maintaining comparable GenEval (Tables 1 and 2). Furthermore, Table 7 demonstrates its applicability beyond FLUX.1-dev, where AC-OPD improves both target suppression and generation retention over Z-Erase on Z-Image Turbo.
Why the combination is not a direct consequence of its ingredients. Although AC-OPD builds on anchor-based erasure and on-policy distillation, their combination does not inherently guarantee effective erasure and generation retention. Our controlled experiments demonstrate that both the source of training states and the supervisory objective are critical to achieving this balance.
As shown in Table 4 and revised Section 5.2, under identical anchor-conditioned supervision, using frozen-model anchor-conditioned trajectories degrades generation retention (GenEval 55.24 vs. 65.04), whereas using frozen-model target-conditioned trajectories yields substantially weaker suppression (Ring-A-Bell ASR 17.63% vs. 2.19%). In contrast, AC-OPD achieves strong suppression and retention by supervising the current student's target-conditioned trajectories.
As shown in the objective ablation in Appendix B.3 of the revised manuscript, even with on-policy sampling, the choice of supervisory objective substantially affects generation retention. Repulsion-only and attraction-plus-repulsion achieve 0.00% Ring-A-Bell ASR but reduce GenEval to 14.48 and 58.30, respectively. In contrast, our attraction-only AC-OPD achieves strong suppression while preserving GenEval (65.86) and COCO (30.72).
Overall, these results demonstrate that effective concept erasure with generation retention does not follow automatically from on-policy sampling or strong suppression objectives alone. Rather, it depends on the combination of student-generated training states and appropriately designed anchor-conditioned supervision.