- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces INTERGROUND, a matched actor–observer paradigm for studying whether learning depends on who generated an interaction, even when the realized trajectory is identical. In human experiments, acting improves structural transfer, whereas standard online supervised adaptation produces little actor–observer difference in language models. The authors further show that enabling pre-action thinking in Qwen3 increases the acting advantage and makes learning more sensitive to whether the executed action matches the learner’s own prior preference, suggesting that learner-specific reasoning can shape how subsequent experience is incorporated.
Critical strengths
- The research question is unusual.
- The paper is easy to understand.
- It has real-world test.
Critical weaknesses
-
The near-zero actor–observer gap under thinking-OFF is partly built into the learning setup. Both learners receive the same realized trajectory, the same supervised targets, and the same number of updates, while the fact that an action was self-chosen is not explicitly represented in the supervised objective. Therefore, the conclusion that “action selection alone is insufficient” may be stronger than what this baseline establishes.
-
Under thinking-ON, the actor and observer no longer receive the same effective learning input, making the effect difficult to attribute specifically to acting. Each learner generates its own private reasoning, which is retained as conditioning context for subsequent learning, so the observed gap may reflect reasoning–trajectory consistency, self-consistency, or on-policy conditioning rather than causal control itself. A stronger control would hold the reasoning prefix fixed across roles and vary only whether the learner’s action preference determines execution.
-
The human and LLM observer conditions are not operationalized in the same way. Human observers passively replay another participant’s actions without forming their own action choices, whereas LLM observers still form an independent preferred action, and under thinking-ON also generate their own private reasoning. Thus, the human comparison is closer to active choice versus passive observation, while the LLM comparison is choice-with-control versus choice-without-control.
-
The practical significance of the matched actor–observer setting is not sufficiently established. The paper extrapolates the findings to agent training and trajectory replay, but does not demonstrate that preserving pre-action reasoning or preferences improves learning in a realistic replay, offline-learning, or long-horizon agent setting. Since both evaluated environments are highly controlled, the broader implication for practical agent training remains speculative.
-
The model coverage is limited and does not include frontier reasoning systems. Although the standard baseline includes several open-weight model families up to 14B parameters, the central finding that thinking increases the actor–observer gap is tested only within the Qwen3 family, and the second-environment replication is conducted only with Qwen3-8B. It is therefore unclear whether the effect generalizes to stronger frontier reasoning or agentic models.
-
The human–LLM comparison is confounded by substantially different learning protocols. Humans receive only four five-turn episodes per hidden rule, whereas models receive many more episodes together with explicit online supervised LoRA updates. As a result, the difference between the human acting advantage and the near-zero LLM baseline may reflect differences in learning algorithm, exposure budget, or interface rather than a fundamental difference between human and model learning.
-
The human study uses a between-subject design and does not fully control for individual differences in learning ability. Sixty participants are assigned to the acting role and sixty to the yoked-observer role, so trajectory matching controls the experienced interaction but not participant-level differences such as rule induction, working memory, or counterfactual reasoning ability. A counterbalanced within-subject design, or at least clearer evidence of randomized assignment and baseline comparability, would strengthen the causal interpretation of the human acting advantage.
Questions for authors
-
How can causal authorship affect learning in the thinking-OFF setup if actor and observer receive the same trajectories, targets, and updates?
-
Can the authors disentangle acting from learner-specific reasoning context, for example by holding the reasoning prefix fixed across roles?
-
Why are the human and LLM observer conditions defined differently, and does this affect the human–model comparison?
-
What realistic agent-learning scenario motivates this matched actor–observer setup, and does retaining reasoning or action preferences help in practical replay settings?
-
Does the thinking-dependent acting advantage generalize beyond Qwen3 and to frontier reasoning models?
-
How much of the human–LLM difference is due to different learning protocols and exposure budgets?
-
Were human participants randomly assigned to roles, and how were individual differences controlled?