- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this paper, the authors examine whether training loss and likelihood scores reliably guide continued LLM training. Controlled experiments show that these signals can misrank training data and hide differences across checkpoints and training settings. The findings support evaluating generated reasoning and individual answers while distinguishing capability changes from output-format effects.
Critical strengths
-
The paper addresses an interesting question about whether commonly used evaluation signals can reliably guide decisions during continued language-model training.
-
The longitudinal analysis covers 107 public OLMo-2-1B checkpoints, providing a detailed view of how evaluation signals change throughout training.
-
The evaluation includes mathematical reasoning, code execution, relational reasoning, and a synthetic learning task, examining several forms of model behavior.
Critical weaknesses
-
The study identifies training choices that improve particular tasks, but does not establish whether these choices improve overall model performance after accounting for gains and losses across different capabilities.
-
The reasoning-conditioned control changes both the reasoning context and the answer format. Consequently, it does not fully separate the contribution of reasoning from that of formatting.
-
The paper reports settings where likelihood scoring performs well and others where generation is strongly affected by formatting. These results establish task-dependent weaknesses, but provide limited guidance about which readout to trust in a new setting.
-
The reported cooldown gains are unclear. At the 4,001B checkpoint, the text first reports a gain of 0.430, but later describes a second data draw changing the gain from 0.442 to 0.326.
Questions for authors
Please refer to the Critical Weaknesses.