- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the identification of unknown erased concepts in diffusion models. It proposes TRACER, which compares original and unlearned weights to construct erasure footprints, then progressively selects concepts from a candidate vocabulary based on subspace coverage. The number of erased concepts is estimated from drops in candidate confidence. Experiments across image and video models show high recovery accuracy and substantial speedups over generation-based probing and membership inference baselines.
Critical strengths
-
The paper investigates an interesting problem that whether model weights reveal undisclosed erasure targets and their number, extending the study of unlearning vulnerabilities beyond recovering known erased concepts.
-
This paper proposes a coherent approach that combines weight-difference analysis, candidate representation processing, and progressive subspace coverage. Avoiding image generation makes searches over large candidate vocabularies potentially practical. The performance looks good while keeping speed fast.
Critical weaknesses
-
Since even the ablated variants substantially outperform the existing baselines, the current experiments do not establish how much of the advantage comes from the proposed components rather than directly exploiting weight differences.
-
Under the evaluation of 50 checkpoints with five erased concepts each, Recall@5 must change in increments of 0.4 percentage points. However, Table 3 reports 16.2%, 36.6%, and 48.2%, may indicating that some baselines are evaluated under different settings.
-
The erased classes are sampled from Imagenette-20, which extends Imagenette’s ten classes (or possibly Imagenette-50, I am not sure since Section 4.1 says Imagenette-20 while Section 4.2 says Imagenette-50). This may limit the evaluation of the method. Given that the method can identify almost all erased classes, Imagenette-20 may not be challenging enough to distinguish performance differences. The authors should evaluate a larger set of classes as erasure targets.
Questions for authors
See weaknesses, I will raise my score if the authors clarify the evaluation details and provide further ablations to attribute the performance gains.
3 comments
Thanks for the authors’ responses. I have increased the rating from 2 to 3.
We sincerely thank the reviewer for the thoughtful feedback and are glad that our responses have addressed the concerns. We appreciate the increased score and will incorporate the clarifications and additional results into the revision.
We thank the reviewer for the careful reading and constructive suggestions. We address each point below.
W1: Attributing the performance gains to the proposed components
We agree that removing one component at a time does not isolate the effect of simply using weight differences. We therefore add a cumulative ablation (Table A) that starts from a naive weight-difference baseline and adds the components one by one. The naive baseline scores each candidate by ∥ΔWxc∥2, the energy of its text embedding projected onto the cross-attention weight change, and ranks all candidates once. The "+ Background suppression" row corresponds to the "w/o progressive selection" variant in Table 5.
Table A. Cumulative ablation in Recall@5 (%) on SD v1.5, using the same checkpoints as Table 5. Baselines from Table 3 are included for reference.
The naive baseline already outperforms both baselines on all four methods (33.2–64.0%), confirming that weight differences carry a strong signal of erasure targets, a core finding of this work. However, it remains far from full recovery, and each component brings consistent gains. Progressive selection contributes the largest gain on every method (17.2–43.6 points), as it separates jointly erased concepts that a single static ranking cannot distinguish. We will add this table to Section 4.4.
W2: Recall@5 values in Table 3
Thank you for this careful check. The reviewer is correct that Recall@5 must change in increments of 0.4 percentage points. The three values are transcription errors; the correct values are 16.0 (ESD, Brute-force), 36.4 (UCE, Brute-force), and 48.0 (ScaPre, MIA), and these corrections do not affect any conclusion. We confirm that all methods in Table 3, including the baselines, are evaluated under the identical setting: the same 50 checkpoints per method and erased-set size, the same 1,000-entry candidate vocabulary, and the same true K provided to all approaches (Section 4.3). We will correct the table in the revision.
W3: Choice and scale of the erased concept set
We apologize for the confusion. "Imagenette-50" in Section 4.2 is a typo for "Imagenette-20"; all object-erasure experiments use the same Imagenette-20 set.
Why Imagenette. Imagenette is the standard object benchmark on which concept-erasure methods such as ESD and UCE validate their object erasure, which ensures that erasure is effective on the evaluated checkpoints. For arbitrary classes, many unlearning methods are not validated and may fail to erase the targets or damage unrelated generation, so identification results would conflate identification failures with erasure failures. To support larger erased-set sizes, we extend the ten Imagenette classes with ten common ImageNet-1k categories. As the community develops new unlearning methods and benchmarks, we will continue to update our code repository and evaluate TRACER on each new method and its corresponding dataset.
Difficulty of the task. The difficulty of identification lies mainly in the candidate vocabulary rather than the size of the target pool. TRACER searches over all 1,000 ImageNet class names, and over 73,406 entries in the expanded vocabulary, without knowing which concepts or how many were erased. This vocabulary contains many fine-grained classes close to the targets; for example, English springer must be distinguished from over one hundred other dog breeds, including Welsh springer spaniel and cocker spaniel, and our exact-set criterion counts any confusion as a failure. The benchmark also clearly separates methods: on the same erased sets, the baselines reach only 4.8–52.0% Recall@5 (Table 3), and the naive weight-difference variant reaches 33.2–64.0% (Table A). The near-perfect accuracy of TRACER therefore reflects the effectiveness of the method rather than an easy benchmark. In addition, Appendix B shows near-perfect identification for artistic styles, a different concept type.
We will clarify these points in the revision, and hope these responses address the reviewer's concerns.