- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies the grokking phenomenon in neural network training, where the model first memorizes then generalizes. The authors connect the memorization to glass state formation concepts from physics, where the sudden collapse of the loss function is paralleled with the formation of the state of hot glass material and generaliztion of the model is paralleled with gradual cooling of the glass material. the authors also propose SAM-SWAP to improve generalization during training. Authors treat the model parameters as the state of the system under study, and the loss function as the energy of the system. The also define the equivalent notions for three metrics in the system: Parameter Movement (PM), Fractal Dimension (FD), and Replica Correlation (RC). These concepts (defined in the context of neural network training) help the authors study the behavior of the model being trained from a physical perspective.
Critical strengths
- Formulation of learning neural networks as a physical phenomenon is interesting. The parallels drawn in the paper may have a positive impact on the current research in AI, especially at this age where AI works like a black box.
- The intuitions of the paper are fair and easy to follow.
- The introduction and abstract of the paper are nice and easy to follow.
- The method "SAM-Swap" is inspired by the swap Monte Carlo method widely used to accelerate equilibration in glass-forming systems. It is simple and effective: swap the values of parameters at random; this will lead to increased Parameter Movement (PM), which means updates from one batch change the parameters mode. It reduces Replica Correlation (RC), which means training trajectories starting from the same phase during training become more similar. It also increases Fractal Dimension (FD), which means the training becomes more stable.
Critical weaknesses
- The organization of the paper is not good. The authors start by defining some metrics, then jump into an experimental setup; Figure 1 is not explained well in advance, yet there are direct references to it in sections 3.1-3.4. Same goes about Figure 2.
- In parts, the wording of the paper is non-trivial and hard to follow, especially for someone with no physics background. For example, what do "presistent and channel like" and "tortuous" exactly mean in this context? "FD characterizes intra-trajectory dynamics, indicating whether optimization paths remain persistent and channel-like or become tortuous".
- Another example of complex explanations: "RC exhibits clear two-step relaxation coinciding with the memorization period and progressively slower decorrelation at longer waiting times, revealing strong history dependence and aging"
- the last paragraph of the introduction is a restatement of the text before it; it could be summarized or removed.
My main concerns about the paper: 1- I'm not sure if the finding related to PM is new, models during training experience higher variations in early training iterations than later iterations. This is somewhat a known fact/intuition among ML practitioners. 2- I'm not sure if the experimental setup reflects a valid setup to be analyzed and make conclusions; the task selected seems to be toy scale, there are only 2 input variables. I expect the network architecture to be very small as well. All of these cast doubt on the validity of the proposed metrics. My main concern here is that the metrics that are studied are formulated based on intuitions that do make sense in low dimensions, e.g., the FD metric does make sense to me when I think of it in 2 dimensions. However, intuition in low-dimensional spaces often misleads us and makes us generalize concepts that do not hold in high dimensions. For that reason I believe the paper needs to study larger AI models.
Questions for authors
Have you studied larger neural networks with more practical applications? If not, I suggest showing your studies via a toy language model with several hundred million parameters.
3 comments
Response to Concerns Regarding Benchmark Scale and High-Dimensional Applicability:
The objective of this work is to study optimization dynamics in a controlled setting where grokking reliably emerges, rather than to establish performance trends in large-scale language models. Modular arithmetic has become a standard benchmark in the grokking literature, including the original work of Power et al. (2022) as well as subsequent studies such as Gromov (2023) and Mohamadi et al. (2024), because it provides a reproducible environment for investigating delayed generalization and optimization dynamics.
Importantly, we also would like to distinguish the dimensionality of the input space and that of the parameter space. Although the arithmetic task involves only two input variables, all three proposed observables characterize optimization dynamics in the high-dimensional parameter space of the neural network, rather than in the input space. Regarding the example of FD suggested by the reviewer, it is defined through the scaling relationship between net displacement and accumulated trajectory length, both of which are mathematically well-defined in parameter spaces of arbitrary dimensionality. A real example would be the ideal straight-line motion and ideal random-walk motion: they always exhibit distinct scaling behaviors regardless of the ambient dimensionality.
The manuscript therefore does not claim direct applicability to LLM-scale systems. Rather, it investigates whether glass-like optimization signatures can be identified and characterized within a canonical grokking setting. At the same time, we agree that demonstrating robustness beyond a single architecture configuration is important. To this end, we conducted additional width-scaling experiments with hidden widths ranging from 128 to 1024 and observed that Adam+Swap continues to substantially accelerate grokking across all tested model sizes. Further analysis also suggests that the qualitative behavior of FD remains largely unchanged across these scales, indicating that the observed dynamics are not tied to a specific architecture configuration or parameter-space dimensionality within the tested range.
While these experiments should not be viewed as a comparison to LLM-scale models, they provide evidence that the reported phenomena are robust to substantial changes in model capacity and parameter-space dimensionality within the studied setting. Detailed quantitative results will be included in the appendix of the revised manuscript. We also believe that extending the analysis to substantially larger architectures would provide an important test of the generality of these observations. We will clarify the scope of our claims and discuss this direction in the revised manuscript.
I thank the authors for their responses. my concern about the model size is partly resolved. regarding paper writing I appreciate the authors' efforts. overall, I believe the score I gave this paper originally is fair. I keep it unchanged.
We thank the reviewer for their constructive feedback and positive assessment of our physics-inspired perspective and the proposed SAM-Swap method. We also appreciate the reviewer's concerns regarding manuscript organization, accessibility, and the applicability of the proposed dynamical framework across different model scales. Below, we address each of the reviewer's concerns in detail.
Response to Concerns Regarding Manuscript Organization and Clarity:
We thank the reviewer for these observations regarding presentation and clarity. The manuscript will be revised to improve its organization and accessibility. In particular, Figures 1 and 2 will be introduced and explained before being referenced in the analysis sections, with more explicit descriptions of the experimental conditions and motivations, allowing the subsequent discussion to be read more naturally. We will also streamline the Introduction by removing repetitive content from the final paragraph.
Several physics-inspired terms and descriptions will be clarified to improve accessibility for a broader machine learning audience. For example, phrases such as "channel-like," "tortuous," and "two-step relaxation" will be accompanied by more direct descriptions of the corresponding optimization behavior. Specifically, "persistent and channel-like" describes trajectories in which successive parameter updates tend to follow similar directions, whereas "tortuous" describes trajectories that frequently change direction. Additionally, two-step relaxation" refers to an initial decrease in replica correlation, followed by an extended plateau and a subsequent decrease. Discussions of aging and history dependence will also be rewritten using more intuitive language to clarify that replicas branched at later training stages decorrelate more slowly under the same perturbation protocol, while preserving the underlying technical meaning. We will also more explicitly distinguish the physical meanings of the three observables: PM quantifies the magnitude of parameter motion, RC measures inter-trajectory similarity, and FD characterizes trajectory geometry rather than training stability.
These revisions are intended to improve readability and exposition without affecting the methodology or conclusions of the study.
Response to Concerns Regarding the Novelty of Parameter Mobility (PM):
We agree with the reviewer that decreasing parameter mobility during training is a commonly recognized phenomenon in neural network optimization. However, we also would like to note that the main contribution of this work is not the observation that PM decreases during training. In fact, PM is included as a reference measure to characterize the slowdown of parameter motion and provide a complementary perspective for interpreting FD and RC. The central contribution is the combination of using three observables to characterize the optimized dynamics in delayed generalization. Specifically, FD and RC reveal changes in trajectory structure and replica-level dynamics that are not captured by parameter mobility alone. For example, a decrease in PM alone cannot distinguish whether parameter motion becomes more directionally persistent or whether independently perturbed replicas remain highly correlated. We will revise the manuscript to make this distinction explicit.