- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes LatentHalt, an adaptive stopping method for latent chain-of-thought reasoning. It calibrates a termination region from an explicit-CoT model and uses a joint curriculum combining auxiliary step supervision with a geometric stopping loss. During inference, latent generation stops when a block-end state enters this region. Experiments across 1B, 3B, and 8B models report adaptive halting and reduced estimated inference FLOPs on four arithmetic benchmarks.
Critical strengths
- Clear motivation and simple design. The paper addresses the practical limitation of fixed latent budgets with a lightweight geometric stopping rule that requires no separately trained halting head.
- Useful empirical analysis. The geometry analysis, cross-domain evaluation, and loss ablations help characterize the stability of the stopping signal and its interaction with step supervision.
Critical weaknesses
- The baseline comparison is incomplete. Table 1 includes Coconut-based SIM-CoT but omits CODI and CODI+SIM-CoT, while Table 3 includes only Coconut as the competing latent baseline. This leaves the competitiveness of the reported accuracy–compute trade-off unclear.
- The advantage of geometric halting over simpler alternatives remains unclear. Appendix C includes fixed one- and ten-block controls, but comparisons with intermediate fixed budgets at comparable compute and a learned halting head under the same joint training are missing.
Questions for authors
- Could the authors compare against CODI and CODI+SIM-CoT under matched settings, reporting both accuracy and inference cost?
- Does the geometric stopping rule outperform a simple learned halting head and fixed-budget alternatives under the same joint training procedure? Could the no-region-loss ablation also be evaluated with suitable fixed budgets?
- Could the authors report measured inference latency and training GPU-hours to establish how the estimated FLOPs and epoch reductions translate into practical efficiency gains?