- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a continual data unlearning method in diffusion models. The proposed method first records denoiser response changes on the same fixed noisy inputs before and after unlearning; then in subsequent updates, only the direction aligning with the recorded directions is penalised. Experiments show the effectiveness of the proposed method.
Critical strengths
- The motivation is clear. In continual data unlearning, subsequent updates may degrade image quality or weaken earlier deletions; this paper proposes a method based on common strategies in continual learning to perform effective continual data unlearning.
- The experimental results on CIFAR-10 and CelebA-HQ demonstrate the effectiveness of the proposed method.
Critical weaknesses
Since data unlearning is for deletion rights, would it be reasonable if the proposed method needs to permanently store noisy copies of deleted samples as probes?
Questions for authors
- It would be better to include an analysis on whether the adversary could reconstruct samples from the probes.
- In Table 3, the reported figures are averages after 20, 50, and 100 deletions; will earlier deletions be recovered after being abandoned (especially for 100 deletions), since the fixed-capacity memory protects the most recent deletions?
- Minor: in line 178, the symbol needs to be explicitly explained when it first appears, not in the appendix.