- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether initial latent optimization can recover target content from concept-erased diffusion models. In its default configuration, IVO first applies DDIM inversion to a reference image containing the target concept. It then optimizes the initial latent using a distribution matching loss (DML) and a direction calibration loss (DCL), while keeping the erased model's parameters and the original prompt fixed. Successful optimized latents can also be stored and reused. The experiments cover eleven concept-erasure methods and tasks involving nudity, objects, and artistic styles. They report both target recovery and prompt alignment, with additional ablations and human evaluation. The paper reports improvements over the evaluated prompt-based attacks in its main experiments.
Critical strengths
- The paper evaluates recovery while keeping the original prompt fixed and considers both target-concept presence and semantic alignment with that prompt. This goes beyond detector-defined success alone and better addresses whether the generated image satisfies the requested content.
- The experiments cover multiple erasure methods and concept types, with loss and initialization ablations and human evaluation. The reported results provide empirical evidence that the optimization procedure can recover target content under the tested conditions.
Critical weaknesses
1. The additional contribution and benefits of optimization are not sufficiently established
W01: Missing comparisons with existing latent-inversion recovery procedures. Although the paper cites Memories of Forgotten Concepts and M-ErasureBench, it does not experimentally compare against the latent-inversion recovery procedures used in these works or clearly explain their omission. Consequently, IVO's advantages over existing inversion-based recovery methods are not sufficiently established.
W02: Missing ablation without optimization after inversion-based initialization. Although the paper compares initialization strategies and loss combinations, it does not report direct generation from the inverted initial latent without subsequent optimization, under the same erased model, reference image, and prompt. The ablations therefore do not sufficiently quantify the additional benefit of optimization over inversion-based initialization alone.
W03: Omission of TINA/TINA+ and insufficient clarification of the additional contribution and validity of inversion-based probing. The paper neither cites nor compares against the closely related TINA and TINA+, and does not clearly explain what additional contributions IVO offers over these optimization-based inversion methods. Moreover, the randomly initialized UNet negative control in TINA+ shows that unconstrained inversion can produce recognizable target reconstructions even when the model has not learned the target knowledge. Successful recovery alone is therefore insufficient to establish that the corresponding knowledge remains in the model. Since IVO also uses reference images and latent optimization for recovery, appropriate negative controls or other effective validation are needed to rule out a similar issue and distinguish functional recovery from evidence of residual knowledge.
Together, these concerns limit the assessment of the method's additional contribution and the interpretation of its results.
2. The motivation and key procedural details are insufficiently explained
W04: Figure 1 provides limited support for the method's motivation. Figure 1 mainly illustrates an association between changes in noise predictions after erasure and target-concept detection rates. Since concept erasure is already expected to alter the model's noise-prediction behavior, this observation provides limited additional insight. Furthermore, the paper does not clearly explain how this association supports the design of initial latent optimization, weakening its role in motivating the method.
W05: Parts of the workflow in Figure 2 are unclear. Some components of Figure 2 are not clearly connected to the method description. The “Search” step in panel (a) is not specified, and the illustration of multiple reference images leading to “Init Latent” can suggest that several images are jointly inverted into one latent, whereas the text describes inversion of a single reference image. Panel (c) corresponds to the latent-reuse mechanism described in the paper, but pool construction, sampling rules, and their use in the experiments are insufficiently specified. This affects both understanding and reproducibility.
Reference:
[1] TINA: Text-Free Inversion Attack for Unlearned Text-to-Image Diffusion Models. CVPR 2026.
[2] TINA+: Probing Residual Visual Knowledge in Unlearned Diffusion Models via Diffusion-Consistent Text-Free Inversion. ArXiv 2026.
Questions for authors
- What are IVO's main additional contributions relative to the inversion-based recovery procedures used in Memories of Forgotten Concepts and M-ErasureBench, and to TINA/TINA+? Can recovery, prompt alignment, and computational cost be compared under suitable shared settings, or can the reasons such comparisons are inapplicable be explained?
- What are the results when generation uses the inverted initial latent without DML/DCL optimization, with the erased model, reference image, and prompt held fixed? How much improvement does the subsequent optimization provide?
- In light of the spurious reconstruction issue identified by TINA+, what negative controls or other evidence support the residual-knowledge interpretation? If a randomly initialized UNet is used, how would the control account for the external information supplied by IVO's default pretrained surrogate?
- How is “Search” in Figure 2(a) implemented, and how are reference images selected? How is the latent pool in panel (c) constructed, sampled, and used in the main experiments? Which results use fresh optimization and which use latent reuse?
Reference:
[1] TINA: Text-Free Inversion Attack for Unlearned Text-to-Image Diffusion Models. CVPR 2026.
[2] TINA+: Probing Residual Visual Knowledge in Unlearned Diffusion Models via Diffusion-Consistent Text-Free Inversion. ArXiv 2026.