- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces several training interventions, such as learning-rate escalation and row normalization, and evaluates them on a transformer trained on modular division, a setting known to exhibit grokking. The stated aim is to compare different routes to grokking and distinguish properties of the phenomenon from effects of the training method. The main interpretations concern hidden formation of a generalizing representation and differences in weight-norm trajectories across interventions; they are qualitative and not sharply stated nor tested.
Critical strengths
The common experimental setup makes the interventions easy to compare, and the appendix documents substantial empirical exploration. This is the main strength of the work. However, the volume of experimentation does not compensate for the absence of a clear and convincingly established scientific conclusion.
Critical weaknesses
The paper modifies training in a system already known to grok, but does not establish what the modifications teach us about the phenomenon. Comparing training paths is a reasonable idea, yet the paper does not develop it into a decisive test of a clearly formulated hypothesis. The limited experimental scope makes this problem more serious. The principal interventions are studied in one task and model configuration, without establishing generality or robustness. In light of the small explanatory value of the results, it is hard to draw any conclusions from these experiments.
The main weakness is that the central mechanistic interpretation is not tested or quantified The claim that an efficient generalizing representation has already formed and merely needs to be revealed is not established nor properly defined. The intervention itself allows substantial further learning. Its outcome is therefore also consistent with partial progress, more favorable optimization conditions, or representation learning during recovery. The experiments do not distinguish these explanations or directly identify the representation claimed to be present. Hidden generalization is just an interpretation.
Likewise, the weight-norm observations are not quantitative and untested. In short, the paper does not turn its collection of observations into a scientific understanding.
Lastly, the idea that a "generalizing structure" can develop before a visible improvement in validation accuracy is already well established in the literature (eg hidden progress, mechanistic interpretability etc) which the author cites. But none of these was compared to, and the added value is unclear.
Questions for authors
What specific new scientific claim about grokking does this paper establish, and which result provides decisive evidence for it? In particular, which existing explanation can the proposed comparison distinguish from its alternatives? What evidence shows that the claimed generalizing representation is already present before the intervention, rather than being developed or substantially changed during the subsequent learning?
Thank you for your thoughtful analysis of my paper.
New scientific claim about grokking: Controlled Demolition Is All You Need for Grokking. Artificially introducing perturbations into otherwise standard training without weight regularization is sufficient to accelerate grokking. Conversely, as shown in A Fix for Softmax and Cross‑Entropy (arXiv:2610.31642), which appeared after my submission, correcting errors in the training implementation substantially impedes grokking. I regard this as an extremely important observation, because most researchers seek to improve and stabilize training, whereas effective generalization, at least on some tasks, appears to require the opposite: making training less well behaved.
I must, however, accept the remainder of your criticism. Indeed, most of the other conclusions admit alternative interpretations, and it appears that these alternatives cannot be ruled out.
Nevertheless, many observations retain their scientific value even in the absence of rigorous proof. For example, the distinction between ricochets and slingshots as two entirely different phenomena is itself a useful observation that, to the best of my knowledge, has not previously been reported in the scientific literature. Correcting cross-entropy almost entirely eliminates slingshots but does not affect ricochets.
Thank you for your thoughtful analysis of my paper. In future submissions to other conferences, I will endeavor to focus on the central phenomenon, avoid diluting that focus, and refrain from including observations that admit multiple interpretations.