- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper conducts a relatively detailed experimental analysis of the relationship between Continuation Supervision and Learned Stopping. The problem angle has some novelty, and the main experiments are also relatively well controlled. However, its core findings highly depend on a specific Selective Repair setting, lack validation across tasks and under conventional training conditions, and the mechanistic explanation is still insufficient. In addition, the writing and organization of the paper have obvious problems, further weakening the presentation of its research contribution.
Critical strengths
S1. The research question is somewhat novel. This paper decomposes the training loss of non-stopping tokens into Continuation Loss and Conditional Content Loss, and separately studies the impact of Continuation Supervision on model stopping behavior. This perspective helps understand how the termination decisions of language models are affected by training signals.
S2. The experimental design is relatively well controlled. While keeping content supervision, STOP supervision, training data, and optimization budget consistent, the authors analyze the role of different Continuation Loss support sets through controlled experiments such as Only-H, Drop-H, Random, and Q-hard. In the main SmolLM2 experiments, retaining high-loss positions significantly improves ROUGE-L, and the results are validated on a larger evaluation set.
Critical weaknesses
W1. The core experimental findings lack generalization and have limited practical contribution. The main positive results are concentrated in a specific Selective Repair setting of SmolLM2-1.7B on CNN/DailyMail. However, in the removal experiments of Native Training, high-loss positions did not show a clear advantage, and similar results were not observed on XSum. Therefore, the paper mainly reveals a local phenomenon under specific training conditions and has not established a generally meaningful training principle. Can the authors explain why the main findings cannot be reproduced in Native Training and XSum, and further validate the applicability of this phenomenon in other models and training settings?
W2. The presentation and Related Work of the paper have clear shortcomings. The abstract piles up many experimental configurations and specific numbers, failing to clearly highlight the research motivation, core findings, and their significance. The main text introduces too many experimental conditions, abbreviations, and repeated restrictive explanations, making the main line of the research hard to grasp and the overall reading burden heavy. In addition, as an ICLR 2027 submission, the references do not even cover work after 2025, and Related Work does not sufficiently position recent related research.
Questions for authors
See weaknesses.
4 comments
Dear Reviewer 7s1f,
Our response distinguishes ordinary full-reference training from the subsequent controlled masking stage. The SmolLM2/CNN-DailyMail finding concerns the removal effect in that stage; broader generalization and a practical training advantage remain unestablished.
Do this distinction and the experimental sequence make the setup and central diagnostic finding clearer? If a definition or a distinction from prior work remains unclear, could you identify the specific point?
Thank you for your time.
Thanks, I have raised my score accordingly.
Thank you for taking the time to reassess our work. Your questions helped us clarify the experimental setup and the scope of our findings. We appreciate your thoughtful feedback and engagement throughout the discussion.
Response to Reviewer 7s1f
What is the central finding? Removing high-continuation-loss positions has a background-dependent effect in SmolLM2/CNN-DailyMail. After ordinary full-reference training, random-removal minus high-loss-removal is 4.81 ROUGE-L points under sparse background, 0.064 points under intermediate background and 0.169 points under dense background. Their direct interaction is 4.64 points [3.37, 6.00], an article-bootstrap interval adjusted at the 95% level for 11 contrasts across three metrics, conditional on three fixed fits. All three block interactions are positive; their variation is reported separately. The revised abstract, Section 6.3 and Table 5 foreground this result.
How are the definitions and experimental flow clearer? Figure 4 shows ordinary parent→own-parent training selection→matched masked tail→fixed evaluation. Let h be total STOP probability, q the conditional non-STOP distribution, and r the identity distribution within STOP. For observed target y, non-STOP cross-entropy is −log q(y)−log(1−h), and genuine-terminal cross-entropy is −log h−log r(y). Conditional-content and terminal supervision remain active while continuation coefficients change; learned q is not frozen.
Table 19 specifies the masks and their continuation coefficient mass. DropH removes 820 high-continuation-loss positions; DropR removes 820 random positions with matched stratum counts from 8,192 eligible positions. Overlap is allowed. Sparse background retains 7,372 continuation units, 0.642% of the matched full-reference cross-entropy control's continuation coefficient mass. Higher background adds supervision outside the eligible set with each removal mask fixed. H/R mass matches within a background, not across backgrounds.
For metric M, define Dγ=M(DropRγ)−M(DropHγ) and RA(γ)=M(DropAγ)−M(DropA0). Then RH(γ)−RR(γ)=D0−Dγ: 4.7456 points for sparse versus half background and 4.6410 points for sparse versus dense background (Appendix E.2).
What does the mechanism evidence establish? Earlier observed-prefix crossovers attribute most of the Smol difference to the stopping donor; one Qwen crossover instead follows the content donor on all 256 outputs. Matched-state local Qwen controls retain content-and-stop-only and zero-dose comparisons (Appendix E.4).
Earlier observed-prefix retention controls probe gradient magnitude and supervision location. For selectively trained parents, high-loss retention still exceeds batch/stratum-matched random retention by 1.407 ROUGE-L points [0.870,1.949] after matching pre-clipping continuation-gradient norms (512 articles; two fixed training orders; individual 97.5% article interval in a two-contrast family). Adam displacement is not matched (Appendix E.6, Tables 29–30). Within-article relocation and re-selection also change the length contrast (Appendix E.7, Tables 31–32). These earlier controls complement the full-reference removal interaction; its parameter-level mechanism remains unresolved.
How are related work and generalization handled? Section 2 distinguishes support intervention from teacher/student EOS semantics [1], inference-uncertainty stopping [2] and EOS-target weighting [3]; Appendix E.3 reports the EOS/excess-loss comparisons. The completed three-fit Qwen2.5-3B experiment now gives a sparse-minus-dense interaction of 0.299 points [−0.338, 0.975], adjusted at the 95% level within its separate five-contrast, three-metric family conditional on those fits. It does not establish the large Smol interaction. Neither model has a masked arm meeting the joint practical criterion against matched full-reference cross-entropy training: 0/6 in each. The earlier selective-parent SmolLM2/XSum comparison also did not establish a high-loss-retention advantage. Appendix E.5 (Tables 25–28) reports all Qwen endpoints, quality measures, control comparisons and individual-fit effects. Together, the results identify how surrounding continuation supervision changes a mask effect even after ordinary cross-entropy training.
References
[1] Yuxiao Yang, Tianrun Yu, Shangzhe Li, et al. (2026). When EOS Tokens Disagree: Understanding Length Inflation in On-Policy Distillation. arXiv:2609.20511.
[2] Yangxinyu Xie, Tao Wang, Soham Mallick, et al. (2026). Statistical Early Stopping for Reasoning Models. arXiv:2602.13935.
[3] Zeno Belligoli, Emmanouil Stergiadis, Eran Fainman, and Ilya Gusev (2025). Controlling Summarization Length Through EOS Token Weighting. arXiv:2506.05017.