- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies whether CoT reveals models’ decisions in profit-driven recommendation tasks, using prompt and CoT swaps, activation interventions, and monitoring experiments.
Critical strengths
The experiments cover multiple models and methods, with useful intervention controls. The authors release extensive code and results and acknowledge several limitations.
Critical weaknesses
The main observations appear consistent with ordinary reasoning—goals influence outputs, changing reasoning can change answers, and choices become clearer as reasoning progresses—yet the paper does not establish what these findings add beyond that expectation. Finding an intervention direction that existing tools cannot interpret does not establish that it represents the decision or explain why CoT cannot report it.
Questions for authors
Which result distinguishes the proposed explanation from ordinary, gradual decision formation? What does the mechanism explain beyond limited predictability from incomplete reasoning?