- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper considers how we might define a meaningful metric for generalization for autoregressive language models, based on recent research that provides such measures for diffusion models. Inspired by the approach taken with diffusion models, the authors consider a metric that is based on coupling -- a property that can be analyzed for Markov chains and applies naturally in the autoregressive setting. The paper presents theoretical results using this metric that are validated in experiments with simple transformers, and that suggest a phase transition from memorization to generalization similar to that seen with diffusion models.
Critical strengths
This paper provides a creative analysis that is grounded out in both a detailed theoretical treatment using a simplified model as well as empirical results with small transformers. I appreciated the motivation from the case of diffusion models and I think the approach did a nice job of translating those ideas into the autoregressive setting.
Critical weaknesses
The key ideas were ultimately explained but the accessibility of those ideas could be increased. Use of an illustrative figure early in the paper that explains the analogy between the diffusion model case and the current approach or illustrates key ideas such as coupling (and maximal coupling) would be valuable.
Translating the results from the theoretical and small-scale settings to more realistic language models would significantly increase the potential impact of this work.
Questions for authors
None
Official Reply to Reviewer FPCn
We thank the Reviewer for their insightful questions that will indeed improve the quality of the manuscript. We will proceed now to answer to their comments here below.
W1: We agree that an introductory figure would make the connection to diffusion models and the idea of maximal coupling clearer. Creating a figure that conveys both ideas well has proved difficult, and we were not satisfied with our initial attempts. Given the short rebuttal period, we focused on addressing the reviewers' points on the contents; however, we take this suggestion seriously and will draft the figure with care after the rebuttal.
W2: We thank the reviewer for this suggestion. Unfortunately, our shared cluster was overwhelmed with requests during this rebuttal period. We managed to run additional experiments to ablate the survival length on transformers trained on the same data set (see our reply to reviewer 7cbD), but we did not manage to run additional experiments on larger instances as well. We will add them to the revised version of the manuscript.