- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes FlowErase-RL, a GRPO-based framework for concept erasure in flow matching models. The method introduces a dynamic dual-path reward mechanism that combines a Concept Erasure (CE) reward for suppressing target concepts with a Non-target Space (NS) reward for preserving unrelated generation capabilities. A performance-driven switching strategy adaptively balances the two objectives during training. Experiments on nudity, object, and artistic style erasure demonstrate promising erasure effectiveness, adversarial robustness, and generation quality.
Critical strengths
-
The research direction is sound and meaningful. The paper explores reinforcement learning as an alternative to conventional supervised fine-tuning for concept erasure in flow matching models, addressing a relevant problem in generative model safety.
-
The framework is intuitive. The dual-path reward mechanism explicitly considers both erasure effectiveness and non-target preservation, providing a straightforward approach to balancing these objectives.
Critical weaknesses
-
The methodological novelty is limited. The proposed framework primarily applies the existing Flow-GRPO algorithm to concept erasure, while the dual-path reward mechanism is relatively intuitive. The methodological contribution beyond adapting existing RL techniques and reward designs to this task remains somewhat limited.
-
Justification for CLIP-based rewards is insufficient. The reward functions rely heavily on CLIP similarity, which does not always faithfully reflect visual or semantic similarity. Visually similar images may receive relatively low CLIP scores, raising concerns about whether directly optimizing CLIP-based rewards can reliably achieve concept erasure and non-target preservation.
-
Questions regarding the ablation results. In Table 6, introducing the dual-path mechanism dramatically reduces ASRₑ from 88.8% to 0.0%, while ASRₖ remains almost unchanged (97.9% vs. 97.8%). This is somewhat counterintuitive given that the NS reward is primarily designed for non-target preservation. Furthermore, Figure 4 shows substantial sensitivity to ρmax, with ASRₑ increasing from 4.2% to 99.4% as ρmax changes from 0.3 to 0.4. These results appear somewhat unusual and warrant further explanation.
-
The paper is not well written. The paper contains numerous inconsistencies that affect its overall clarity and presentation. For example, the metric directions for FID and CLIP are reversed in Table 6 and the reference to "table 4" in the ablation on ρmax is incorrect.
Questions for authors
-
Could the authors further clarify the methodological novelty of FlowErase-RL beyond applying Flow-GRPO with relatively straightforward reward designs?
-
Could the authors discuss the limitations of CLIP similarity as a reward signal and its potential discrepancies with actual visual similarity and concept preservation?
-
Could the authors explain the unexpected results in Table 6, particularly the dramatic improvement in ASRₑ without a corresponding improvement in ASRₖ? Additionally, could they clarify the strong hyperparameter sensitivity observed in Figure 4?