- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper investigates whether the direction of a world model’s prediction error provides useful information for choosing actions beyond the magnitude of that error. It expands the squared distance to a goal representation into terms involving error magnitude and alignment with the goal. Candidate plans are executed separately in a simulator from the same starting state, allowing alternative scores to compare the same plans using their observed outcomes. In the main comparison, both scores receive each candidate’s actual squared prediction error, while one additionally uses the directional information.
On PushT, the additional information improves the selection of successful plans, with a similar result from a separately trained predictor. Further experiments examine prediction history, changes to error direction, and selection during search. Cube-Single and a learned correction explore the limits of translating this diagnostic information into additional task success.
Critical strengths
1. The main comparison isolates a specific source of information and measures its effect on task success.
The paper goes beyond showing that selecting plans using their observed outcomes is better than selecting them using predictions. Both scores in the main comparison already receive each candidate’s actual squared prediction error. They choose from the same candidate plans and differ by the additional goal-projection term. This provides a meaningful test of whether that term improves selection beyond the particular magnitude-based correction being compared.
Critical weaknesses
1. The study provides a useful diagnostic result, but the scientific insight and evidence for its broader significance remain limited.
The mathematical observation that error direction affects squared goal distance follows directly from expanding the distance expression. The substantive contribution, therefore, lies in showing that this distinction affects the selection of physically successful plans. The PushT experiments provide evidence for that finding, including a comparison using a separately trained predictor. However, the clearest positive result remains a retrospective comparison within particular candidate pools, where the scores already have access to the observed outcomes. The work needs to establish enough additional understanding to make the result consequential beyond those comparisons. In my assessment, it does not sufficiently characterize when the directional information provides a meaningful advantage or how the finding should guide the evaluation of other world-model planners.
The additional experiments leave that broader significance uncertain as well. On Cube-Single, the energy-aware score already selects successful plans from 29 of the 30 pools containing a success. The small additional gain, therefore, offers limited evidence about the benefit under other planning conditions, although it is a useful illustration of the limits imposed by the available candidates. The attempted learned correction also does not establish a reliable improvement over the original score.
The main PushT confirmation also leaves an important comparison incomplete. The paper selects as its preferred energy-only score on the discovery data and evaluates it on R1, but does not report it on P2. Reporting this already-selected alternative without further tuning would strengthen the evidence that the directional advantage persists beyond the specific comparator used in the main result. Taken together, these limitations make the extent of the new understanding less convincing than the positive PushT result alone suggests.
2. The presentation substantially obstructs understanding of the approach and its findings.
The abstract introduces paper-specific notation without defining the underlying quantities, while the introduction announces the main result before clearly explaining the retrospective comparison. Section 2 supplies mathematical definitions, but leaves the reader to reconstruct why the different scores are introduced, what information each receives, and how their comparison answers the research question. The paper does not provide the connections needed to follow the approach as it is presented.
The organization of the experiments creates a similar problem. Multiple experimental groups and filtering conventions are introduced before their purposes are clear. For example, some historical analyses exclude candidates that succeeded early, while the main comparison includes them. The reason for this distinction appears later in Appendix K, even though it changes which plans can be selected and how the results should be compared. A clearer explanation of the procedure, followed by an overview linking each experiment to its scientific question, would substantially reduce the reader’s burden. For a paper whose primary contribution is improved understanding, the current difficulty in extracting and assessing that understanding is a weakness.
Questions for authors
-
What are the P2 success rates and latent-cost regrets for , using the coefficient already selected on discovery without further tuning?
-
Among the already-executed PushT candidates, does the projection-aware score retain its advantage when all compared scores are restricted to plans from the final CEM iteration? Please indicate how many candidates remain in this comparison.