- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors aim to address the gap between error awareness and self-correction in LLM chain-of-thought reasoning. They use the Jacobian lens to identify doubt-related token representations in erroneous reasoning steps and apply activation steering along these directions and probe-derived error directions. Experiments on three LLMs and three reasoning datasets show that these interventions can elicit doubt-related tokens and improve recovery from erroneous steps.
Critical strengths
- The paper is clearly written, with well-defined concepts and easy-to-follow explanations.
- The paper presents a coherent research narrative, examining the pathway from error awareness to hidden doubt and self-correction.
Critical weaknesses
- Insufficient motivation. The authors claim that prior work either detects error awareness without correction or relies on external control. To my knowledge, several studies have already explored using internal error signals to facilitate self-correction, making this motivation less convincing.
- Underexplored concept of hidden doubt. While hidden doubt is an interesting idea, the paper does not sufficiently establish its existence as a distinct internal representation or how to evaluate it. Instead, the analysis largely focuses on the well-studied relationship between error awareness and self-correction.
- Limited novelty and new insights. Most findings are closely related to prior work. Amplifying error-related signals to induce reflection is potentially interesting, but the results are inconsistent and insufficiently explored. The method also largely follows the existing J-lens framework without substantial modifications.
Questions for authors
Regarding Weaknesses 2 and 3: Can the authors provide evidence that hidden doubt is a distinct internal representation, rather than merely a manifestation of error-related representations? In particular, can the two be disentangled through additional analysis or controlled interventions?
Regarding Weaknesses 1 and 3: Could the authors further reconsider and clarify the novelty of this work in light of existing studies on error awareness, reflection, and activation steering? In particular, what new insights does this paper offer beyond prior research?