-
The writing is unnecessarily complicated and really difficult to follow.
-
Limited novelty and insufficient insights beyond existing work.
The proposed method seems relatively straightforward, and many of the experimental findings are largely predictable. For example, it is not surprising that additional consequence-prediction supervision benefits smaller models or models trained with less data. And that larger benefits with less training data or smaller student models are consistent with standard expectations for knowledge distillation. Although the paper includes several ablation studies, I do not think they provide much deeper insight into why the method works or under what conditions it is genuinely useful.
-
Unclear informativeness and reliability of teacher-generated candidate predictions.It is unclear what genuinely new information the teacher contributes through its predictions about unchosen actions. For example, the paper illustrates a candidate action go to fridge 1 with the predicted consequence (navigate, fridge 1, at:fridge 1, success). This consequence seems largely predictable from the action description itself, potentially even by the smaller student model without additional teacher supervision.
I would like to understand whether the proposed method teaches meaningful state-dependent environment dynamics or merely reinforces relatively trivial action–effect associations. The paper reports does not adequately evaluate the quality of predictions for unchosen actions or investigate how teacher prediction errors affect downstream learning.
-
Missing critical baselines for world-model learning and student-generated predictions.
The current baselines do not adequately establish that the improvement specifically requires predictions generated by a larger teacher model. In particular, I would like to see comparisons with:
a. Student-generated candidate predictions: Have the student model generate its own predictions about unchosen actions and use them for auxiliary training. Does the stronger teacher actually provide additional useful knowledge?
b. World-model supervision from realized transitions: Train the student to predict actual next observations or consequences using the existing executed trajectories. How much additional benefit comes specifically from the unexecuted alternatives?
c. It would also be interesting to compare against explicitly asking the student to predict candidate consequences before selecting an action at inference time.
Without these comparisons, I find it difficult to determine which component is responsible for the reported gains.
- Insufficient differentiation from existing world-model approaches.
The proposed approach appears closely related to existing work on world modeling and action-consequence prediction for language agents. For example, Web Agents with World Models (Chae et al., https://arxiv.org/abs/2410.13232) already explores predicting the consequences of candidate actions to improve agent decision-making.
More closely related to the training setup, Policy and World Modeling Co-Training for Language Agents (Lu et al., 2026, https://arxiv.org/abs/2606.02388) uses auxiliary world-modeling supervision to improve policy learning without requiring additional inference-time computation.
While the proposed method differs in using teacher-generated predictions for unexecuted actions, I do not find the paper's discussion sufficient to establish why this distinction represents a meaningful advance over existing approaches.