- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how an injected commitment affects LLMs’ CoT and final answers. The core finding is that the commitment migrates from the injected tokens into the reasoning chain generated by the model itself; by the end of the chain, the answer is mainly influenced by “the chain the model wrote,” rather than by the still-readable commitment itself. The paper also uses fixed-chain splicing to decompose direct / mediated effects, masking, attention attenuation, a no-passage ablation, and a second model family.
Critical strengths
The paper is innovative in its approach. It does not limit itself to unfaithful CoT, but attempts to interpret CoT as carrying an injected commitment.
Critical weaknesses
- The experimental setup has strong limitations. The conclusions are based on very small models and disabled thinking. Whether all the conclusions still hold on larger models and in reasoning modes is worth verifying.
- The paper consists entirely of behavioral observations of models on a single simple dataset. It lacks observations across a wide range of domains; in particular, it lacks internal mechanistic / representational analysis.
Questions for authors
- The introduction raises the problem of multi-turn agentic scenarios, but the full paper only analyzes the simplest setting such as BoolQ, and does not answer the question raised at the beginning. Broader real-world validation across more scenarios is desired.
- The main conclusions of this paper could be validated using a flagship reasoning model.
- The conclusion of this paper is that the CoT generated after an injected commitment makes the model more inclined to generate content in the direction of this commitment. Since CoT is conditioned on the commitment, this seems like a normal phenomenon, unless the CoT process does not leak any content related to the commitment. It would be best to provide an example and statistics in the paper showing what the model’s actual reasoning chain looks like. For example, a compelling demonstration would be: two CoTs generated with and without commitment, neither of which exposes any commitment at all, both looking like natural reasoning, yet leading to drastically different yes/no logits.
- As I understand it, the mask experiment in Section 4.3 is the same as the direct setting defined in Section 3: commitment information + a natural CoT that does not read the commitment. What is the point of this experiment?
- Why do the title says "first token"? What is more important, the semantics of the commitment or its location?
Please respond to the authors
Hello!
Just a friendly bump that you should engage with the authors response