- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Despite significant attention in recent years, detecting and mitigating memorization in diffusion models remain unresolved. This paper considers the local spectral profiles of the denoiser along generation trajectories, and observes that objects such as the spectral gap and entropy effective rank exhibit interesting behaviors that appear to characterize the trajectories leading memorized samples. Based on these observations, the authors propose and develope three mechanisms: one to regularize training to suppress memorization, one to detect memorized generations during inference, and the third one is a steering strategy to redirect memorized trajectories during inference to reduce memorization.
Critical strengths
(S1) Studying memorization and generalization from a trajectory perspective is less explored in the literature and is a natural and meaningful direction.
(S2) The observation that the spectral gap shows a sharper transition across time within a memorized trajectory (than a non-memorized trajectory) is new and interesting. (That said, studying local geometry or inspecting generation trajectory has appeared in the literature.)
(S3) The paper provides careful experiments. The three proposed mechanisms, especially the GeoSteer-DM, appear to be effective.
Critical weaknesses
(W1) The paper empirically observes that the spectral gap exhibits an interesting sharp transition for memorized trajectories. It hints that this transition might be associated with the entry of the memorization basin. However, no (ideally theoretical) justification is really provided for why such a transition should appear in general. Given that the main trajectory-level experiments are only carried out only on CelebA32 with about 4K images, it might be that the observed spectral-gap behavior captures only one aspect of the underlying phenomenon. It is not clear whether this is the fundamental object governing memorization, and also it would be important to provide more insights on why memorized trajectories should have such behavior. (The spectral recovery observation and analysis is less surprising.) Without further justification or insights, this part of the paper feels somewhat incremental.
As a more minor remark: the paper begins with memorization basin, and gives a formal definition in Section 3.1. The memorization basin itself is a very interesting object. Unfortunately, the later observations and studies are only tangentially connected to the memorization basin. In my view, the paper hasn't provided no strong evidence that the spectral gap transition indeed characterizes the entry of the memorization basin. The experiments in later sections also do not really use or leverage this concept. So there seems to be a gap between the motivating concept (of memorizatoin basin) and later studies.
(W2) While the experimental results are promising, some design choices are not fully aligned with the earlier observations/ narratives. A few examples are:
-
Spectral gap is the quantity that shows the sharp transition. But GeoReg-DM uses the first singular value for reguliarization. The reasoning for this is not clear, and ideally the paper should also report resultings using a spectral-gap based regularization.
-
Similarly, spectral gap transition is highlighted in early part of the paper. However, the proposed JER for memorization detection was based on effective rank. At the very least, I feel that the paper should report results using spectral gap for memorization detection empirically even if it is not as good as the current JER.
-
How is the range of timesteps over which the steering is applied chosen? (I saw some choices are given in the appendix.) It will be interesting to probe where GeoSteer actually gets its most benefit. For example, the paper describes the dominant intermediate-noise mode. Perhaps it will be interesting to test whether most of the steering gain comes from that regime.
-
The stable diffusion setup is only used for the GeoSteer experiments. I understand that for unconditional diffusion memorization may be less common when input training set is not too small. Nevertheless, it would be interesting to study the behavior of such spectral objects for the conditioned case, as well as to test the effectiveness of GeoReg-DM and JER there.
Minor comment: -- The paper [R1] also studied memorization from a trajectory perspective, and it showed that the middle range is the danger zone where memorization forms. I wonder whether there are any deeper connections of the two studies.
[R1] Dodson et al, "Two Calm Ends and the Wild Middle: A geometric picture of memorization in diffusion models", ICML26.
Very minor comment: -- The PDF file I downloaded from OpenReview does not render properly on my Windows machines (I tried multiple laptops). In particularly, many plots / figures are not showing. Eventually I found that it works on my iPad (although not all plots show proper labeling). I am not sure whether this is an issue only happened to me. Nevertheless, the review above is independent of this small presentation issue.
Questions for authors
see Weakness