- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies the question whether choices are made in the computations that produce the reasoning tokens or before that.
Critical strengths
Paper aims to study an interesting and timely question. The implication of an answer to this question can impact both the development of new methods (e.g early exits) and impact trust calibration (if models dont rely on the reasoning tokens this is an additional evidence that we should not rely on the reasoning text as an explanation).
The paper is written clearly, easy to follow and present its results clearly.
Critical weaknesses
It is not clear if how the results in the paper would extend to other models, what puts in doubt the way the paper draw conclusions. Results on other models could be impacted by a number of factors, and mostly by their training regime. The amount of RL training and the constraints that were put during that training might have a crucial impact on such results. If models were RL trained for small portion out of their entire training they might exhibit less reliance on the process of producing reasoning tokens. Also, if models were trained to support several reasoning "efforts" they might tend to reach a conclusion earlier. An investigation into those factors would be very beneficial to this paper.
A comparison between models that would verify that this phenomena is consistent across more models of different sizes, companies etc. would benefit this paper and support the claims the authors drew.
Without such further experiments the claims in the paper could be interpreted in a way that will make them overclaiming in some cases. In order to mitigate that Id suggest the follwoing change:
- All 3 conclusions in the last paragraph in the intro should be hedged to communicate that those are things that can happend in LLMs, rather then present those as typical behavior of LLMs.
- The abstract should communicate the scope of the experiments and either specify the models that were tested or at least that 3 small models were tested.
Questions for authors
The examples in the main body of the paper are not all needed and mostly can go into the appendix.