- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper evaluates LLMs on the "food truck" test, which challenges a model to infer the food preference of a stimuli according to its action trajectory when navigating between two food truck locations. ToM questions regarding the stimuli's belief and food preference (e.g., desire) are raised to the model at End-step, where the model use the full trajectory to answer, and Every-step, which the model use partial cumulative actions to answer. Model performances are compared against judgements from 16 human annotators and outputs from a BToM model. Results show that judgements from advanced models align well with human judgement and exceeding the performance of the BToM model. Several correlation and variance partitioning studies are conducted to understand the gap between strong and weak model and to investigate major failure modes of the weak models.
Critical strengths
- Each scenarios is run 16 times per model through independent API calls and the mean and confidence interval of each model is reported. This improves the statistical robustness of the results especially considering the relatively small () sample size.
- LLM judgements are compared with those from human and a normative BToM model. Further, the authors proposed four hypothesis (e.g., lesioned BToM models). These experiments and analysis partially helped with understanding potential modes of failure of the tested LLMs.
- Desire and Belief, the two important aspects of ToM, are studied independently.
- The variance partitioning studies provide useful complement to further enhance the conclusion about correlation between Worse models and the lesioned BToM models.
Critical weaknesses
-
Lack of information on human annotation. As human ratings are used as the ground truth and serves as the basis for model evaluation and analysis, I consider this as the most critical weakness.
- It is unclear how the human judgements and their ratings are obtained.
- There is no inter-annotator agreement reported, diminishing the validity of human ratings.
- It is also important to disclose basic annotator information such as their demographic, compensation, instruction given before annotation, and the annotation platform/tool used for this study.
-
The introduction to the "Every-Step" setup is unclear. From Ln222, it seems that the full trajectory is always accessible to the LLM regardless of the setup. If this is the case, then the step-wise BToM tackles a completely different task where it only has partial observation up to the timestamp whereas the Every-Step setup has access to the full context. The prompts in Appendix A do not help with understanding the context the LLM sees in Every-Step
-
The bottom two figures of Figure 5(a) is missing legend.
Questions for authors
- What are the useful insights that the "hindsight" model bring? It reads the "hindsight" model is reducing the original POMDP setup to a MDP setup. Then what do the results from such reduction indicate except for the correlation? Would the so-called hindsight bias exists in a POMDP-formulated step-wise setup where the full trajectory is not accessible to the model?
- How are the human annotations obtained (see Critical Weaknesses Section)?
- How reliable are the stepwise rating given by the BToM model? While a large scale assessment would be infeasible, a small scale validation would significantly improve the informativeness and credibility of the Every-step study.
We thank the reviewer for the detailed reading and for recognizing the strengths of our work. We reply to each point below.
Summary of revisions (all new analyses in App. H): (1) Further experiments on hindsight bias: three conditions that change one factor of Every-step (Every-step-single, Single-trunc, Prefix-step; Figs. 11–14), run for Claude-4.6-Opus, Gemini-2.5-Pro, and GPT-5.4. (2) A fit of the Hindsight weight λ and a sensitivity analysis over λ and temperature β (Fig. 10, Tables 6–7). (3) A spatial comprehension control on the same prompts (Fig. 15). (4) Better statistics: scenario-bootstrap intervals for every statistic, and paired bootstrap tests against the human–BToM benchmark.
R3-1. Human ratings. These are not new annotations: they are the published experimental data of Baker et al. (2017), collected for this task, and we use them unchanged. Details are now in Appendix B. Reliability computed with our pipeline was high: split-half reliability of the group mean (Spearman–Brown) was 0.95 for desire and 0.91 for belief (range over 1,000 splits 0.93–0.97 and 0.85–0.94), and a held-out participant correlated with the rest of the group at r = 0.73 (desire) and 0.57 (belief).
R3-2. What the model sees in Every-step. The reviewer's reading is correct: the full trajectory is in the prompt, and the model is instructed to rate each step using only the evidence up to that step. To compare directly, we added Prefix-step, which truncates the log at each queried step and asks the End-step question, so the LLM sees exactly what BToM uses. The Hindsight pattern disappeared in all three models tested, suggesting that it did not originate from a ToM-specific reasoning failure. However, the Prefix-step condition did not make the LLMs normative, and their response profiles were largely consistent with the End-step condition.
R3-3. Figure 5(a). We thank the reviewer for pointing this out; the legend has been added.
R3-4. What Hindsight adds. Hindsight does not reduce the POMDP to an MDP; that reduction is TrueBelief, where the agent knows the world state from the start. Hindsight keeps the agent's POMDP and changes only the observer's inference: once the agent has seen Spot 2, the estimate of its initial belief is pulled toward what it saw (App. D.3). The two differ before Spot 2 is visible, and better-performing models follow Hindsight there: the pull toward the true state appeared only after Spot 2 became visible (before: Opus 0.01–0.08; Gemini 0.00–0.04). GPT-5.4 follows TrueBelief.
R3-5. Reliability of stepwise BToM. We have no additional human test, but two results support it. First, BToM uses the same model and parameters at every step, and its final-step prediction is the one validated against humans (r_desire = 0.91, r_belief = 0.78). On the 22 Check-Partial scenarios, whose trajectories end before the agent reaches a truck, BToM agrees with humans as well as on the rest (r_belief = 0.81, [0.65, 0.91] vs. 0.77, [0.67, 0.86]). Second, in Prefix-step the step-to-step belief changes of the better-performing models followed BToM's (r = 0.36, [0.26, 0.44], and 0.26, [0.18, 0.33]), and desire changes followed BToM in both Prefix-step and Every-step (App. H). A human stepwise study remains future work.