- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The to repeatedly apply diffusion model denoising on the same noise level to find attractors at each level of noise, hypothesizing that the most prominent modes, the modes of memorized samples, would keep have theor attractors intact for hghger levels of noising (the critical sigma_c): The largest noise level at which an example remains retained under these dynamics. They experiment with memorization which they induced for cifar-10 training, and known memorized prompts in SD.
Critical strengths
The fixed-scale dynamical interpretation provides a useful connection between mean-shift dynamics and memorization. The controlled CIFAR-10 experiments cover all main mechanisms of memorizatoin: duplication, rarity, and overfitting.
Critical weaknesses
My main concern is that the novelty relative to prior work on when memorization emerges during denoising should be positioned more carefully. Several works have already shown that memorized images become identifiable or effectively determined unusually early in generation. Wen et al. detect memorized prompts from signals available at the first denoising step [1]. Humayun et al. show that memorized images resolve faster along diffusion trajectories [2]. Jain et al. identify an early attraction-basin regime in which classifier-free guidance commits trajectories toward memorized images [3]. Kim et al. similarly report that memorized training-image information is overestimated during early denoising, causing rapid trajectory collapse toward memorized examples [4]
These results are conceptually close to the observation that memorized examples persist to larger noise scales. I therefore see the main novelty less as showing that memorization is visible “earlier” or at higher noise, and more as the fixed-σ dynamical-system construction, its mean-shift interpretation, and the resulting persistence statistic σc. A direct comparison between σc and prior notions of memorization emergence/transition timestep would substantially clarify what additional information the proposed method provides.
References
[1] Wen et al., “Detecting, Explaining, and Mitigating Memorization in Diffusion Models” ICLR 2024.
[2] Humayun et al., “What Secrets Do Your Manifolds Hold? Understanding the Local Geometry of Generative Models” ICLR 2025.
[3] Jain et al., “Classifier-Free Guidance Inside the Attraction Basin May Cause Memorization” CVPR 2025.
[4] Kim et al., “How Diffusion Models Memorize” arXiv, 2025.
Questions for authors
Kindly see weaknesses.
4 comments
Rebuttal (2 of 2)
(c) Comparison with each method.
- Wen et al. [1] score the prompt alone. We extensively compare in the paper (Tab. 1) showing are compared in, where they cannot detect image-caption pairing, and on cost (App. G.5); they also cannot localize memorized content or detect unconditional memorization (Secs. 3, 4.2, 4.3). New (App. G.4): on 298k LAION images (SD 2), how much the caption helps inpaint an image tracks local gap better than [1] ( vs. ).
- Humayun et al. [2] show group-level curves of decoder geometry along sampling, without a per-prompt score. We turned their local scaling into one (Table R1): It tracks how often the image is sampled (-), so it can detect frequently sampled memorization but misses rare memorization.
- Jain et al. [3] locate where guidance commits a trajectory to a memorized image. As a detector their transition point stays weak at every sampling probability (Table R1). Moreover, finds the basin without guidance (App. B.5): guidance only changes how often sampling enters it (copies drop from 66% to 32% at ).
- Kim et al. [4] measure early trajectory collapse. This detects frequently sampled images but not rare ones (Table R1). It also fires on template prompts that rarely reproduce their image, which instead separates from verbatim copies (AUC 0.83 vs. 0.59).
Methodological comparison summary Table.
| Wen et al. [1] | Humayun et al. [2] | Jain et al. [3] | Kim et al. [4] | (ours) | |
|---|---|---|---|---|---|
| Detects caption-conditioned memorization | ✓ | ✓ | ✓ | ✓ | ✓ |
| Detects memorization in unconditional models | ✗ | not tested | ✗ | ✗ | ✓ |
| Detects memorized images that sampling rarely or never produces | prompt only | ✗ (Tab. R1) | ✗ (Tab. R1) | ✗ (Tab. R1) | ✓ |
| Detects whether an image belongs to its caption (pairing) | ✗ | ✗ | ✗ | ✗ | ✓ |
| Localizes memorized content spatially | ✗ | ✗ | ✗ | ✗ | ✓ |
| Defined without guidance | ✓ | ✗ | ✗ | ✗ | ✓ |
| Needs no sampling from noise | ✓ | ✗ | ✗ | ✗ | ✓ |
| Needs no access feature encoder or decoder | ✓ | ✗ | ✓ | ✓ | ✓ |
| Has an analytical model of the signal | ✗ | ✗ | ✗ | ✓ | ✓ |
[1] Wen et al., ICLR 2024. [2] Humayun et al., ICLR 2025. [3] Jain et al., CVPR 2025. [4] Kim et al., arXiv 2025.
Thank you to the authors for their response - I would raise my score accordingly
We thank the reviewer for their follow-up, and for raising their score. Thank you again for the constructive feedback and suggestions that helped us improve the paper.
Rebuttal (1 of 2)
We thank the reviewer for their feedback and suggestions. In the following we address the reviewers comments: we uploaded a revised version of the manuscript where all edits are highlighted in red. We remain available during the discussion period for further clarifications.
Relation to prior work on early memorization (Wen et al., Humayun et al., Jain et al., Kim et al.)
We thank the reviewer for their comment. We agree that the fact that memorized images show up early in generation is known in the literature (Wen et al., Humayun et al., Jain et al., Kim et al.) and we do not claim it as our contribution. Our contribution lies in proposing the dynamical system framework for diffusion models, its connection to mean shift theory and to memorization through the critical scale. This framework yields a theoretically grounded, interpretable measure that can localize memorized content and distinguish the roles of the image, the caption, and their interaction. To show what the critical scale σc adds, we proceed in three steps:
All details and new experiments are now fully reported in the new App. H.
(a) What σc measures that an emergence time does not. The measures in [1-4] are properties of a sampling trajectory starting from noise. That is a question of reachability of sampling trajectories. σc is a property of a candidate image: the orbit starts at x, and one asks up to which noise level x survives as a fixed point. That is a question of persistence of candidate input. The two are related but measure different things. A memorized image can persist as a strong attractor even when its basin is reached too rarely to be observed with a finite sampling budget. The theory shows that they depend on the data differently. σc grows linearly with an image's isolation and only logarithmically with its mass (Thm. 5). The probability of sampling the image grows with its mass.
(b) Memorization that persistence detects and reachability misses.
To test what critical scale can predict differently than prior measures conducted a new experiment on Stable Diffusion v1.4.
Table R1. AUC of memorized prompts vs. controls, by probability of sampling the training image. ± is the half-width of the 95% bootstrap interval. Humayun et al.: local scaling of the decoder at the current latent xt, mean AUC over 5, 15 and 50 of 50 DDIM steps, scored on the 100 controls on which it was computed.
Additional evidence already in the paper.
[1] Wen et al., ICLR 2024. [2] Humayun et al., ICLR 2025. [3] Jain et al., CVPR 2025. [4] Kim et al., arXiv 2025.