- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CIE-SCORER, a framework for detecting unfaithful Chain-of-Thought (CoT) reasoning by examining discrepancies between generated reasoning traces and the model's internal computations. Specifically, the method efficiently constructs compact sentence-level circuits from informative reasoning tokens, builds internal and external reasoning graphs, and measures their discrepancies using Fused Gromov–Wasserstein distance. Experiments on four datasets from FaithCoT-Bench demonstrate that CIE-SCORER achieves state-of-the-art performance while reducing the computational cost of circuit construction.
Critical strengths
- Existing CoT unfaithfulness detection methods often rely on generated text or output behavior. This paper introduces information from the model's internal computations, offering a new perspective on the relationship between generated reasoning traces and the underlying computational mechanisms of language models.
- The paper combines circuit tracing, token selection, graph neural networks, and Fused Gromov–Wasserstein (FGW) distance to represent internal computations and external reasoning traces within a unified graph-based framework, providing a new approach to CoT unfaithfulness detection.
Critical weaknesses
- The authors assume that internal computational circuits can provide evidence of the model's actual reasoning process and use them to assess the faithfulness of external CoT traces. Although the authors demonstrate the classification capability of internal circuit features, the ability to predict unfaithfulness labels does not necessarily indicate that these circuits capture the model's actual decision-making mechanisms.
- When constructing sentence-level circuits, the authors use only the current sentence as the activation context, without tracing the original question or the preceding reasoning steps. Although this design reduces computational cost, it raises an important concern: whether these sentence-local circuits remain sufficiently consistent with the model's actual internal computations during reasoning.
- The proposed method assumes that faithful reasoning traces should align with the model's internal computational process, whereas unfaithful traces should exhibit discrepancies. Although this assumption is intuitively reasonable, more thorough theoretical or empirical justification is needed.
- The authors combine predictive entropy and counterfactual necessity scores to select informative tokens. However, high predictive entropy does not necessarily indicate that a token makes a significant contribution to the model's reasoning decisions.
- Additional experiments should be conducted to evaluate the effects of FGW hyperparameters and different sentence segmentation strategies on detection performance.
Questions for authors
See weakness