- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper studies model collapse in the Gaussian setting. They compute the expected KL divergence between the original Gaussian and the estimated one after t rounds. They also investigate decaying real-data mixing and show that, in this setting, it cannot prevent collapse. The authors also track KL and reverse KL for GPT-2 training initially on WikiText-2, and then on synthetic data.
Critical strengths
- The idea of clearing up some disagreements regarding model collapse is well motivated, and the Gaussian MLE setting is very clean. The analysis is straightforward.
Critical weaknesses
-
Scope of the theory: Much of the analysis is known. In fact, in talks and presentations on model collapse that I gave in the past, I presented both Theorem 1 in this paper and the variance contraction in Theorem 2. The Gaussian case has been analyzed since the first paper on model collapse by [1] and in subsequent works such as [2, 3].
-
Relating results to existing ones: There is essentially no discussion of how the results relate to existing ones, despite this already being a very crowded space. Connecting to my previous point, much of this analysis is not novel, so careful discussions that specify what exactly the theorems contribute beyond what is already known are needed.
-
Data Mixing and Accumulation: The entire part of the paper around mixing somewhat feels disconnected from a long line of works that already showed that model collapse does NOT occur in natural mixing regimes (e.g. [4, 5, 6]). The authors make statements such as “Can the mixing fraction decrease over time while still preventing collapse? No” which feel detached from the current state of the field. Once again, the authors do not discuss the relation to any of these, the role of the decaying mixing factor, and the role of data replacement instead of the (perhaps more natural) data accumulation setting.
-
Inconsistency of Results: The regime theorem 2 needs for equation (3) is (so that the order 3 remainder is small), but in such a regime, much of the behavior the authors discuss breaks. First, the authors say “the strictly positive correction is the quadratic cliff that compounds collapse faster than linearly in ”, which is false if you are in the regime. Moreover, there is no real collapse in the regime, since the KL stays relatively close. The regime the paper requires for collapse is , but much of the discussion and interpretation of the results does not hold in that regime.
-
Experiments: It's not clear what the authors hope to accomplish with the figure. The figure doesn’t actually show collapse by standard definitions, as the KL divergence stabilizes, and does not continue to grow linearly or to diverge to infinity as the Gaussian theory suggests.
[1] - The curse of recursion: Training on generated data makes models forget, Shumailov et al., 2023
[2] - Collapse or Thrive? Perils and Promises of Synthetic Data in a Self-Generating World, Kazdan et al., 2024
[3] - Rate of Model Collapse in Recursive Training, Suresh et al., 2024
[4] - On the stability of iterative retraining of generative models on their own data, Bertrand et al., 2023
[5] - Universality of the Pathway in Avoiding Model Collapse, Dey and Donoho, 2024
[6] - When Models Don't Collapse: On the Consistency of Iterative MLE, Barzilai and Shamir, 2025
Questions for authors
Can you address the weakness above?