- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates knowledge capacity degradation in low-bit language models, showing that ternary models can exhibit severe capacity collapse despite relatively modest increases in training loss. Through experiments on GPT-2-style models ranging from 2.5M to 50M parameters using synthetic biographies, the authors attribute this phenomenon to learning-rate dwell instability and abnormal output-head behavior on difficult-to-learn tokens. They further demonstrate that short WSD cooldowns and reduced output-head learning rates can mitigate the observed collapse.
Critical strengths
- Interesting empirical observations. The paper highlights a discrepancy between conventional loss-based evaluation and measured knowledge capacity in low-bit training, offering a potentially useful perspective on quantization quality.
- Detailed training dynamics analysis. The authors conduct extensive controlled experiments involving learning-rate schedules, fixed-LR interventions, corpus variants, and output-head optimization. These analyses provide useful insights into the observed instability.
Critical weaknesses
- Severely limited scale and questionable generalizability. All experiments are conducted on extremely small models (at most 50M parameters) and synthetic data, far removed from practical LLMs. More importantly, the central findings concern learning-rate dynamics and training stability, which are strongly dependent on model scale and training configuration. The paper itself observes substantially different collapse-onset learning rates between 25M and 50M models. Without validation at more representative scales (e.g., 1B–8B), it is difficult to assess whether the proposed mechanism and remedies remain relevant to modern LLMs. This substantially limits the significance of the conclusions.
- Unclear validity of the claimed knowledge collapse. The observed capacity degradation appears largely driven by abnormal predictions for a particular token (birth month), while other factual attributes remain mostly unaffected. Moreover, the reported collapse is sensitive to the capacity estimator, and the alternative compression-based estimator does not detect the same collapse at 25M. These findings raise concerns about whether the paper demonstrates genuine knowledge loss or primarily an output-head instability amplified by the evaluation metric.
Questions for authors
- Generalization to practical LLMs. Can the authors provide evidence that the observed collapse and learning-rate dwell mechanism persist at substantially larger model scales and under more realistic training conditions? Given the scale dependence already observed between 25M and 50M, even targeted experiments at intermediate scales (e.g., 800M–1B) would materially strengthen the conclusions.
- Distinguishing knowledge loss from metric artifacts. Can the authors provide more direct evidence that factual knowledge is genuinely forgotten, rather than the capacity reduction being dominated by a few abnormal token predictions? In particular, how should the apparent absence of collapse under the alternative compression-based estimator be reconciled with the paper's central claim?