- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This proposes a new method called BEM to erasure concepts from modern flow-matching models. Prior work (like GEM) use velocity-matching objectives and this paper raises the point now that this silently assumes a Squared Distance measure for the divergence to the wanted "erased" behavior, which penalizes every deviation from the ideal velocity direction equally. The paper reveals that this choice does not have to be that way: any so-called "Bregmann diverence" can be used, leading to more complex penalization constraint, for example, one that is derived from the preserved utility of the model. The authors propose to learn this divergence measure in a bi-level optimization by parameterizing it as a strictly convex function (apparently a property that Bregman divergences need to fulfill according to its definition). They evaluate BEM within the evaluation framework of GEM by essentially plugging in their proposed, regularized BEM objective.
Critical strengths
- Inspiring perspective and clear derivation of the motivating thoughts.
- Novel idea to use a learned objective for concept erasure instead of relying on a static divergence measure or fixed regularization.
Critical weaknesses
- Absence of ablations to substantiate the design choices. Even though I know that this method seems to be quite compute-heavy, I would have expected (1) some variations in the design of the potential network , (2) sweeps of the weight , (3) fixed-potential variants, (4) no regularization, and (5) alternative choices (ESD loss, GEM loss, ...) accompanied by the BEM bi-level Bregman-potential regularization.
- The paper never fully discusses the around 50x longer runtime of BEM compared to GEM; and what that means for practical deployment.
Questions for authors
Future Work
- Is it possible to choose a different criterion that, e.g., also includes an entire set of retention concepts, or erase multiple concepts simulatenously?
- Can you provide some ablations to support the design of your method? Especially, ablations like (3-5) from the ones mentioned under critical weaknesses would help to better judge the effectiveness of the approach.