- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the role of CoT in the state tracking task of LLM Agent, and mainly distinguishes the contribution of Computation and Memory. The authors build a file-locking state tracking environment, and through comparing different CoT generation and retention conditions, they find that current generated CoT can significantly reduce the violation rate, while the extra benefit from retaining historical CoT is limited. In addition through experiments such as Reasoning Swap, Linear Probing and Activation Patching, it analyze the relationship between CoT content, internal state representation and Agent behavior, and find that CoT content can affect subsequent actions, but the decodability of state information does not necessarily reflect its causal effect on behavior.
Critical strengths
-
The authors employ Linear Probing and Activation Patching to examine the relationship between state representations and model behavior from various perspectives, providing a comprehensive analysis.
-
The experimental setup is well-designed; the authors evaluate different model scales, various conditions for retaining information during inference, and longer task sequences, while also reporting confidence intervals.
Critical weaknesses
The primary issue with this paper lies in its experimental design. The paper’s central claim is that computation is more valuable than memory; however, the experimental design compares only direct/cmd, think/cmd, think/body, and think/full, omitting the direct/full condition. This is surprising, as the current experiments only demonstrate that when a model engages in "re-thinking," the original Chain-of-Thought (CoT) may offer little additional value. Conversely, when the model does not re-think, the original CoT could still be valuable and lead to lower violation rates. Consequently, the existing experiments are insufficient to support the core conclusion that computation is more significant than memory.
Furthermore, although the authors report high rates of generation truncation in the appendix (42.7% in some experiments and 28.7% in others), this issue is not adequately addressed in the main text. Given that the paper’s central conclusion relies on CoT generation, such a high degree of truncation may compromise the comparability of different experimental conditions. The authors should explicitly discuss the impact of this truncation and provide a robustness analysis to account for it.
Finally, the claim that the specific content of a CoT influences a model’s subsequent behavior offers limited novelty. While the authors demonstrate—through intervention experiments—that an erroneous CoT can indeed affect an agent’s actions, this phenomenon is not particularly surprising. The paper fails to clearly articulate what new, mechanistic insights these findings provide beyond what is already established in existing literature.
Questions for authors
-
Why were the high generation truncation rates not sufficiently discussed in the main paper? Could they affect the main experimental conclusions?
-
Why was the direct/full condition not evaluated? This seems to be a natural and important baseline for distinguishing the effects of current reasoning generation and historical reasoning memory.
3 comments
Thank you for the additional experiments and clarifications. They largely address my original concerns about the experimental setup.
My remaining concern is about the paper's central contribution. Since the full observation and action history is always available, the experiments seem to compare generating new reasoning with retaining previous reasoning, rather than computation and memory more broadly. The finding that current reasoning is more effective when the state changes seems somewhat expected under this setup. While the new experiments make this distinction clearer, I am still unsure what fundamentally new insight they provide into how CoT works, beyond demonstrating its behavioral benefits in this task. I would have expected a clearer explanation of what makes current reasoning effective and what broader understanding of CoT in agent decision-making we can draw from these findings.
Based on the current situation, I tend to keep the score unchanged.
Thank you for the follow-up, and we are glad that the new experiments address your concerns about the setup. We agree that we compare current and retained reasoning while the full history stays in the prompt, and Sections 1 and 9 state this scope. A retained note can go out of date after a state change, and Section 5 tests how the agent responds when this happens. However, we think our results show more than the behavioral benefit of CoT. Most of our experiments change what the agent reads or writes, and they show which content the action depends on and where current reasoning fails. Three findings in particular are not predicted by the setup.
After a state change, retained notes help only when the agent reasons over them. Without current reasoning, retained notes do make the agent follow an outdated value. After a toggle locks a file that its note calls unlocked, retaining the notes raises Qwen3-8B's unsafe moves from 10 to 31 of 75. With current reasoning, the same notes instead raise its response to the toggle by 0.14 [0.04, 0.24] (Section 5). Memory and computation therefore work together here: the notes are useful as input to reasoning at the decision.
Current reasoning fails at a specific step, and labels help only when the agent reasons. In all 21 remaining unsafe moves of Qwen3-8B with reasoning, the same file had been toggled earlier, and the trace concluded that it was unlocked. When we label each announcement as a separate event, unsafe moves with reasoning fall by half (26 to 13 of 75, with both wordings rerun in the same session), while the direct agent shows no clear change (Section 5; Appendix I.2). The traces that switch to a safe command list both toggles and conclude that the file is locked again. The reasoning thus updates the state by combining the events in the history, and its remaining errors are consistent with difficulty telling repeated events apart.
Reasoning helps even when no update is needed. At files whose lock never changed, reasoning lowers violations from 12.8% to at most 0.4% of attempts for Qwen3-8B and from 10.1% to at most 1.7% for Qwen3.5-9B (Appendix C.5). A correct state table before the command does not reproduce this benefit (Section 6). Editing only the lock statements in a finished trace shifts the model's answer about the lock but changes the move in one pair, while swapping the whole trace redirects the action (Section 7; Appendix H). As in our reply to reviewer jvFL, current reasoning therefore does more than track the state. It connects the state to the commands the task allows, and the action follows the trace's conclusions.
For CoT in agent decision-making, these results point to two roles of current reasoning: combining events into the current state, and applying the task rules to that state before the action. Retained reasoning supports these steps but does not replace them. Because the action follows the trace's conclusions, a trace should be evaluated by how those conclusions affect the next command, and not only by whether the state it reports is correct.
We hope these points clarify the contribution of the paper, and we would be grateful if you would take them into account in your final assessment. Thank you again for your time and for the detailed feedback throughout the discussion.
Thank you for your time and constructive feedback. Your missing-condition point led to the most informative new experiment.
A direct rollout writes no reasoning to retain, so we built these conditions from saved decisions. We took 400 decisions per model from reasoning rollouts, kept observations and commands fixed, and retained earlier replies as cmd, body or full. Then we generated the next command directly or after new reasoning (Section 4, Table 1). Violations per 100 decisions:
You were right: retained reasoning helps a lot when the agent does not reason (direct/full versus direct/cmd). Its benefit is much smaller once the agent reasons. We now state the claim this way: computation at the current decision gives most of the benefit for an agent that reasons at each step, and retention substitutes only in part. The two routes also differ: direct/full avoids violations partly by moving less (24 against 67 safe log-file moves for Qwen3.5-9B; Appendix E). At 16 turns, full retention also helps an agent that reasons (2.8 points [0.6, 5.1]; Appendix D).
Section 5 shows why retention cannot replace current reasoning. After a new toggle makes a correct note wrong, an agent with notes but no current reasoning responds little. Current reasoning makes the action follow the event (difference in signed response 0.26 [0.16, 0.35] and 0.21 [0.14, 0.28]; Figure 3).
They do not change the conclusions. Section 3 now defines forced closure: when reasoning reaches its token budget, we close the thought block and ask for the command. In the main runs, it affects 2.0 to 6.9% of reasoning turns, and excluding those turns leaves the generation effect unchanged (Appendix C). The 42.7% and 28.7% rates came from secondary runs with a smaller budget. We reran the goal-file, 16-turn and scale runs with the main-run budget. The 28.7% run duplicated the main run's seeds with less budget, so we removed it. Appendix R lists the budget, the share of turns at the budget, maximum tokens and GPU time for every run.
We agree that changing an answer by changing its reasoning is not itself new. Our contribution is to connect reasoning interventions to a state whose current value can be checked independently.
Together, these results connect the behavioral benefit of current reasoning, its influence on action selection, and the limits of using state readouts to explain behavior. They do not locate where the state is first computed.
Thank you again for your time and feedback, which led directly to the new experiments. We hope these answers resolve your questions about the missing condition, truncation and novelty.