- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper discovers the spacing effect for memorization in language model training, i.e., the observation that training data repetitions that are spaced in time tend to produce stronger memorization than repetitions massed closer together in time. By pretraining transformer models with 3m-1b parameters on standard pretraining corpus combined with canary data with controlled repetition schedules, the paper validates this claim for small , measuring memorization by ranking-based exposure and likelihood-based depth metrics. However, they also observe a non-monotonic effect as continue to increase, which the paper leave as an unclaimed phenomenon. They also observe that although massed repetitions create memorization that are lower than spaced repetition, both schedules still produce stronger memorization than random placement of canary, indicating that massed repetition alone is insufficient to be used for reducing memorization.
Critical strengths
Overall, I find several new phenomena that the paper observed quite interesting and intuitively reasonable, especially
- spaced repetitions have higher memorization than massed repetitions
- both variants still produce memorization higher than conditional random repetitions.
- the canary repetition schedule appears to be carefully designed to rule out other confounding factors that affect memorization, though the presentation often lack the necessary clarity to fully understand and appreciate the design. See weaknesses - clarity.
Critical weaknesses
- Clarity: The paper frequently uses vague or metaphorical language, ambiguous references, and phrases whose logical connections are difficult to follow, which substantially hinders understanding. For example, I had difficulty interpreting the seven quantities listed in the introduction as affecting memorization.
- Item 3 states: "Decay-weighted copy count: with the last copy pinned, wider spacing still ages the earlier ones. The ageing is constitutive, not separable, so we cross this count with k instead." It is unclear what exactly is meant by "cross this count with k," or how the preceding explanation motivates this choice. The following statement, "Crossing has power only where the ageing is not multiplicative in k," is similarly difficult to interpret without further explanation.
- Item 5 states: "Absolute position in training: a constant rate does not remove it, and it is large (Section 4.7)." It is unclear what "a constant rate" refers to, what exactly is meant by "it" or "large," or why absolute position in training should affect memorization.
- As another example, the caption of Figure 1 describes the right panel as "what that buys on exposure, primary arm." The term "primary arm" is not explained, and neither the caption nor the panel title ("what it buys") clearly communicates what the figure is intended to illustrate.
These are not merely stylistic issues: the ambiguous language makes it difficult to identify and evaluate the paper's claims. I encourage the authors to use more precise, self-contained descriptions, particularly when introducing key concepts and explaining figures.
- Scope: the paper restricts itself to canary memorization, which largely made the canary's memorization independent of the remaining training data, and made the impact to practical training data repetition less clear. It would be nice if the authors could at least add a discussion on whether such observations are likely to appear for practical repetition beyond canary repetition. The only place that looks related to practical canary is the "real prose" discussed in line 396. However, it consists of only a couple lines of vague references, and I find it challenging to make sense of the result and configuration.
"Real prose. On WikiText-103 test passages disjoint from train and validation the massed penalty holds on depth in all 12 matched seeds (p= 4.9 ×10−4†). The interior contrast does not resolve on exposure (p= 0.15)."
Questions for authors
- Could you clarify what exactly is the configuration and result for the "real prose" experiment in Line 396? This is for understanding whether the observed phenomenon hold for practical data repetition beyond random canary.
2 comments
Clarity revisions and results on larger models (85.1M and 302.3M)
Thank you again for your detailed comments on clarity. As the discussion closes soon, we wanted to check whether the revised text addresses your concerns. Every passage you quoted is now written in plain words, and our reply above shows each one before and after. The main changes are the abstract (lines 11 to 37), the list of confounds and the new Terms paragraph (lines 49 to 92), and Figure 1 (lines 108 to 125).
On your question about real data, the penalty holds on real prose: +0.152 nats [+0.136, +0.168] on depth, positive in all 12 seeds (lines 409 to 419). We have also since run the main retention test at two larger model sizes, 85.1M and 302.3M, and the penalty is present and larger at both (Section 4.8).
If any passage is still unclear, we would be glad to rewrite it before the discussion closes.
Response to Reviewer Q64q
Thank you for reading the paper so closely, and for the specific examples. You are right that these passages were unclear, and we are sorry for the extra effort they caused. The design itself is unchanged, and we rewrote the text that explains it. All seven items in the introduction's list (lines 49 to 79) are now in plain words, and the sentence after the list says how the design handles each one.
Item 3 (lines 57 to 64). Before: "The ageing is constitutive, not separable, so we cross this count with k instead." After: "With the last copy pinned, a wider spacing has to put the earlier copies earlier, so they have longer to fade. That is part of what spacing means, so no design can hold it fixed. Its direction is what matters: fading can only make wide spacing leak less, so it can hide the effect but not create it. Every count also runs at every spacing, which we call crossing count with spacing. That compares spacings within each count but does not remove the fading. Crossing separates fading from a spacing effect only if fading hits some counts harder than others; if it removed the same share at every count, crossing could not tell them apart." We hope this makes clear what the earlier "not multiplicative in k" sentence meant.
Item 5 (lines 67 to 71). Before: "Absolute position in training: a constant rate does not remove it, and it is large (Section 4.7)." After, the item is headed "How far into training a copy arrives, or absolute position" and reads: "Even at a constant learning rate, a model at step 500 is less trained than one at step 4,000. In a separate test with one copy per canary set and the copy's distance to the end of training held fixed, later copies leak more (Table 6). Wider spacing moves copies earlier, so where we measured it, this pointed against the effect." In the old sentence, "it" was how far into training a copy arrives, and "a constant rate" meant the constant learning rate of item 4. Holding the copy's distance to the end fixed keeps this separate from recency, item 2. We also removed "it is large".
Figure 1 (lines 108 to 125). The right panel shows the main result: at the same count and the same last copy, spaced copies give higher exposure than massed ones. Each point is how much higher exposure is at that spacing than at s=1, paired within seed. We claim the rise from s=1, not the peak or the fall. The panel titles are now "the design: four schedules" and "the result", and the caption defines the primary arm as our 10.6M reference configuration.
Real prose (your question, lines 409 to 419). The original passage was too brief, and the paragraph now gives the full configuration. It is the primary configuration, with the same counts, 2 to 64, and the same pinned last copy, but every injected sequence is a real 256-token passage from the WikiText-103 test split, disjoint from training and validation. Tokens 0 to 127 are the prompt and 128 to 191 are scored. Exposure ranks the true span against spans resampled from all of the run's passages, injected or not. With 12 seeds at each of four spacings, the massed penalty is +0.152 nats [+0.136, +0.168] on depth, positive in all 12 seeds, and +0.240 bits [+0.168, +0.312] on exposure. Both intervals are within one canary panel. The p=0.15 in the original sentence was a different test, the peak against the widest spacing, which we do not claim.
Scope. The real-prose arm answers part of your question about canaries. Its passages are real text of the same kind the model trains on, not digit strings, and the penalty holds on them, although they are still injected copies. In practice, shuffling, curriculum, epoch structure and data ordering all set a duplicate's schedule at a fixed count. Section 4.3 reports two more experiments on real held-out passages with heavy-tailed counts from 2 to 55. In the first, a comparison of three schedules, random placement of the earlier copies approximates a shuffled corpus, and its leakage is the lowest: 0.627 nats, against 0.721 clustered and 0.847 at s=20. In the second, a calibrated membership attack (Table 5, now labelled as real prose), copies at s=20 leak more than massed ones by +0.078 in true-positive rate [+0.060, +0.098]. The gap is larger at k of 5 or less, the low counts real corpora mostly contain: +0.118 [+0.080, +0.160]. So one count can carry different leakage depending on its schedule, and a new paragraph (lines 420 to 425) makes this point. Organic copies usually sit far apart, beyond the spacings where we claim the rise, so we do not extend the rise to them.
You wrote that the unclear language made the claims hard to identify and evaluate. The abstract, the introduction and Figure 1 now state the claims in plain words. We would be happy to clarify anything that is still unclear, or to address any other concern. If the revision resolves your concerns, we would be grateful if you would consider updating your assessment.