- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the revival of suppressed concepts in diffusion models. They first show that quantization alone does not revive concepts, but restoring different percentages (also just 5%) of the weights with the largest absolute change from those in the original model does affect reemergence. They introduce a benchmark (DuraBench) that measures erasure durability across different models. They also propose a method (SPARC) that partially restores weights and learns to maintain these responses after restoration.
Critical strengths
- The proposed benchmark is a useful tool to investigate the suppression capability of erasure models
- SPARC shows that there is hope that the problem of reemergence can be solved
Critical weaknesses
- The paper needs to be better written in the story it tells: the quantization framing seems disconnected from the paper's main message. The paper could be improved, for example, by focusing less on quantization, including in the abstract. The phenomenon is not new in the literature (starting from the "The illusion of unlearning" paper, which is not mentioned)
- SPARC is evaluated on the same prompts during evaluation of the benchmark, so explicitly on the attack it is trained on
Questions for authors
- How does the durability ranking change with random restoration?
- Can you include proper unlearning benchmarks such as UnlearnCanvas and HUB?