- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Mosaic, a method for compositional multi-concept erasure in text-to-image models. It also introduces CoME-Bench to evaluate the erasure of multiple target concepts in the same image. Mosaic uses the vector field differences between the original model and concept-erased models to construct spatial masks. These masks are then used to blend different vector fields during generation. Experiments on FLUX.1-dev show that Mosaic outperforms several baseline methods in different compositional settings.
Critical strengths
- CoME-Bench provides a useful evaluation setting for multi-concept erasure. Unlike existing benchmarks that evaluate target concepts separately, it considers multiple target concepts appearing in the same image.
- Mosaic combines concept-specific erasure models through spatial vector field blending. This is a reasonable way to reduce the interference between different target concepts without additional training for their combination.
- The experiments cover different concept combinations and several baseline methods. The ablation studies and experiments on overlapping concepts are also useful.
Critical weaknesses
- Table 11 shows that several object concepts have relatively low erasure success rates. For example, the success rate for Wolf is only 16.3%. Meanwhile, Table 8(d) shows that Mosaic performs worse than MACE in the three-object setting. Although Appendix F provides some analysis, the performance on difficult compositions remains limited.
- The main experiments are conducted only on FLUX.1-dev. CoME-Bench also uses flow-based T2I models during its prompt generation and verification process. Therefore, it is unclear how well Mosaic generalizes to other T2I models.
- Mosaic requires multiple forward passes during sampling. Table 15 reports an inference latency of 2.63× and 3.44× compared with the original model when erasing two and three concepts. This cost increases with the number of target concepts.
Questions for authors
Please see the weaknesses above. I am willing to keep a positive rating if these concerns are properly addressed.
3 comments
We thank Reviewer kCK6 for the constructive feedback. We have addressed the reviewer's concerns in our rebuttal and would appreciate any follow-up on whether our response resolves the issues raised or whether any concerns remain.
My main concern remains the limited erasure effectiveness in challenging compositional object erasing. The new preservation results help explain the advantage over MACe, but the absolute erasure success rates for some concepts and three-concept combinations remain relatively low. The computational overhead also remains a limitation, as acknowledged by the authors. I therefore decide to maintain my original rating.
We thank the reviewers for highlighting this observation. We acknowledge that Mosaic achieves lower ESR than MACE in certain challenging compositional settings, particularly when the number of target concepts increases. However, as shown in our quantitative results, MACE exhibits substantially lower Selective Alignment (SA) scores than Mosaic (e.g., 0.73 vs. 0.89 in the three-object setting and 0.75 vs. 0.90 in the one-character + two-object setting, respectively), indicating that MACE tends to interfere more with the generation of non-target concepts. This suggests that the higher ESR achieved by MACE in these settings may come at the cost of preserving unrelated scene content.
To further investigate this trade-off, we conduct additional evaluations of non-target (NT) region preservation in the three-object and one-character + two-object settings using LPIPS, SSIM, and two DINOv2-based similarity metrics: DINO and DINO-patch [1],[2]. Specifically, we use SAM3 to identify non-target regions and obtain corresponding spatial masks from images generated by the original FLUX model. We then apply the same masks to the original FLUX-generated images and the corresponding erased images to assess how faithfully each method preserves the original appearance and structure of non-target content. DINO measures the cosine similarity between features averaged over non-target patches, while DINO-patch averages the cosine similarities between spatially corresponding non-target patch features. Both DINOv2-based metrics use the same non-target mask derived from the original image.
These results indicate that Mosaic better preserves non-target regions than MACE, revealing a trade-off between erasure effectiveness and non-target preservation in challenging compositional settings. Nevertheless, the absolute performance of both methods remains limited on these difficult tasks. We therefore agree that improving erasure effectiveness in challenging cases while preserving non-target content is an important direction for further research.
[1] Caron et al., Emerging Properties in Self-Supervised Vision Transformers, ICCV 2021
[2] Ruiz et al., DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation, CVPR 2023
Thank you for raising this concern. To examine generalization beyond Flux.1-dev, we conduct an additional experiment on Flux.2-klein-base-4B, which was not used in CoME-Bench construction. This model uses a different text encoder and VAE, resulting in different text conditioning and image latent representations. We therefore train new concept-specific erasure LoRAs for this model and apply Mosaic to compose them.
We evaluate the Mario + SpongeBob combination using the same 96 prompts and generation seed. The table below reports ESR, Selective Alignment (SA) and Aesthetic score.
As shown in the results above, Mosaic is also applicable to Flux.2, achieving effective concept erasure while preserving non-target content and image quality. EraseAnything exhibits a similar trend to that observed on Flux.1 as in Table 8, which is outperformed by our method. In contrast, the MACE fusion rule does not transfer successfully to Flux.2 under our experimental settings: it produces severely degraded images, making its high ESR misleading as an indicator of successful concept erasure. This degradation is reflected in its substantially lower SA and aesthetic scores.
We acknowledge that computational efficiency is one of the limitations of Mosaic, as demonstrated by our experimental results in Tables 6 and 15. We agree with the reviewer that reducing the computational overhead is an important direction for future work.