- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes a new decoding scheme "Transition Thinking". Their method is based on insights they find through experiments which span:
- Evaluation of latent reasoning methods at inference time (no finetuning)
- Intermediate layer decoding
- Loop detection in CoT
The paper starts by evaluating soft thinking methods and find uncertainty is very low in the thinking states corroborating previous results in the literature.
The paper then shows that there is a critical layer in models at which confidence shoots up (i.e. entropy goes down sharply). They find that this phenomena has correlation with looping: when the final layer hesitates, sometimes holds a confident alternative token. Inside repetition loops, they find the opposite (final layer certain, diffuse).
Finally, the paper presents In-place Collapse Escape (ICE) as a novel method to detect and mitigate loops in the CoT. Their method is a simple algorithm which monitors if entropy has been low (under a threshold) for some amount of time. If it is the case, the method checks for repetitions of strings up to a period of about ~1024. If a loop is indeed detected, the method forces random (almost uniform) sampling of top tokens to break the loop.
Together the paper's results shed light on different aspects which play a part in test-time decoding in the context of reasoning tasks.
Critical strengths
The main strength of the paper for me is the novelty of the finding/approach. The authors cleverly combine insights from three different subfields of LLM reasoning (latent thinking, intermediate layer decoding, repetition detection).
Critical weaknesses
-
I found the paper hard to read. The paper strings together findings from different subfields of LLM reasoning (latent reasoning, intermediate layer decoding, repetition detection). This culminates in the novel method they present. However, upon first read (especially of the intro) I found that it is hard to identify the research question/gap in the literature highlighted by the paper. It feels like multiple disjoint findings are reported. I think a sharper narrative could help this out. I feel a sharper intro is not a far cry away; the findings culminating in the method proposed already hint at this.
-
The method, although interesting, does not improve performance meaningfully compared to the proposed baselines. Results reported in Table 2 show that performance increase is only about 1-2%. Moreover, when performing component analysis in Table 5, just using repetition penalty (RP + CoT) seems to have a huge effect on performance, even beating TT on AIME26 for Qwen 8B.
Questions for authors
- what is ? This is defined nowhere in the main text.
- The analysis is only done on Qwen models, which are known to exhibit specific phenomena not found in other model families. Would it be possible for the authors to report/confirm that their findings replicate on other LLM families?
- Could the authors report how many loops are avoided compared to e.g. cold stop or even just how many loops avoided compared to simple argmax baseline? It would be interesting to have a principled testing of ICE in isolation, not just results which report increase in accuracy, but also results which report meaningful decrease in loop count.
- Many parameters (1-nat threshold, ½ factor, ρ = 1.05, 0.01 nat, 256 steps, 64 tokens, top-20, 3 escapes, 90% match) are not ablated over. Were these hard to tune? It is hard to get a sense of how finicky the method is to tune without this information.
- The ablations in Table 5 do not discuss length. Could the authors provide the length of the generations for the component-wise analysis? This would be interesting as it would shed light on which components are most important to driving the token count down.