- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Paper Summary
The paper studies "trace-grounded inconsistency" in tool-using LLM agents: cases where an agent's chain of thought (CoT) or user-facing response disagrees with its recorded actions or the evidence available to it. The authors develop a ten-category taxonomy covering reasoning–action mismatches, unsupported or contradicted claims, and hidden uncertainty. Using this taxonomy, they annotate 1,080 τ²-bench conversations from six open-weight agents, and add 198 LLM-rewritten pairs to cover rare categories.
Critical strengths
Critical Strengths
- Important, well-motivated problem. Checking an agent's stated reasoning against its execution trace is a practical, verifiable alternative to probing internal faithfulness. The finding that successful tasks often contain inconsistent accounts is useful for evaluation practice.
- Careful taxonomy and annotation. The taxonomy has explicit criteria and exceptions. Annotation uses two independent annotators, reconciliation, and verification by a third annotator, with about 81% agreement.
- Principled auditor design. Decisions are made by executable, interpretable rules, and the LLM verifier may only reject a report, never confirm one. This reduces reliance on LLM-as-judge.
Critical weaknesses
Critical Weaknesses
-
The "CoT" framing overstates the contribution. The paper measures external say–do consistency between an agent's statements and its trace, not CoT faithfulness in the usual sense. The most frequent category (RM-1, about 43% of occurrences) concerns user-facing responses rather than the CoT, and is essentially grounded hallucination. RA-2 largely reflects incomplete CoTs rather than contradictions. The paper should be positioned against prior work on thought–action consistency and agent hallucination, such as Bouzenia & Pradel (2025), MIRAGE-Bench, and AgentHallu. Relative to that work, the novelty of the taxonomy is incremental.
-
The labels are not independent of the auditor. Appendix H.5 acknowledges that some labels were added after annotators reviewed the auditor's reports. This inflates the reported recall and precision. The annotators are also the authors who designed the taxonomy and the auditor.
-
Key baselines are missing. The only comparison is against hand-written rules, which reach just 10–20% recall. The paper reports no standalone LLM-as-judge baseline over the full transcript, even though the backup pass essentially implements one. Without it, the value of this complex rule-generation pipeline is unclear.
-
The contribution of RL is not isolated. The RL-versus-base comparison counts "useful candidates" (30 vs. 92) rather than end-to-end recall and precision. RL is trained only on RM-1 and RE-1, which dominate the label set. Results are micro-averaged, and per-category results are not shown in the main text. In Table 3, test recall and precision are both exactly 190/209; please confirm this.
-
Scope is limited and the pipeline is heavy.
- Evaluation covers a single benchmark with simulated users and open-weight agents only.
- Exploratory "plans" in thinking models' CoT may not be commitments at all.
- The pipeline depends on a 397B extractor, and claims the extractor misses can never be detected downstream.
Questions for authors
Questions For Authors
- How do recall and precision change when evaluated only on labels created before any auditor output was seen?
- How does a standalone LLM judge, for example Qwen3.5-397B reading the full transcript, compare to CoTAudit in recall, precision, and cost?
- Can you report per-category results, and end-to-end recall and precision for the RL-trained versus base-model rule generators?
- How does the work differ conceptually from agent hallucination and thought–action consistency benchmarks? Is "CoT faithfulness" the right framing, given that most violations concern responses?