- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This is an interesting paper that identifies what it calls resolution collapse in latent-space planning. The authors identify this problem as a learned world model ranking candidate action sequences reasonably well at intermediate rollout frames, however, the ranking of the candidates retained by CEM is near chance at the terminal frame used for optimization. The authors measure this in four simulated tasks; they vary the planning horizon and propose ranking candidates at an earlier frame selected from the model’s measured resolution curve. They report modest success-rate gains when comparing their method with spread-matched random-cost controls.
Critical strengths
The idea behind the paper is interesting because it questions an assumption that is often taken as given in many works: a learned world model can reliably rank candidate plans at the very horizon the planner optimizes. It's also very timely, with world models becoming a promising direction for many tasks in AI.
The paper is also well written overall.
In more detail, I believe measuring ranking quality within CEM’s elite set is a sensible diagnostic. The distinction between ranking the full candidate pool and ranking the shortlisted candidates is clear and potentially important.
Additionally, the paper includes useful controls, especially the spread-matched random-cost comparisons, and reports paired tests and detailed appendices.
Finally, the proposed intervention is simple and may be practically useful if its benefits generalize.
Critical weaknesses
The paper has a few weaknesses that would need to be addressed before acceptance.
For example, I believe the cause is not perfectly established yet through the horizon experiment . The authors interpret the collapse moving with the terminal frame as evidence that it tracks CEM’s optimization target, rather than prediction time. But doesn't changing the horizon also change the candidate sequences and the distribution CEM searches over?
Moreover, the default evaluation goal is 25 environment steps ahead; the horizon experiment extends prediction to as many as 40 steps. Isn't the longer-horizon terminal cost temporally mismatched to the goal If the goal if the embedding remains tied to 25-step? The paper should clarify exactly how the goal and true cost are defined for these longer-horizon experiments, and ideally test the target-frame explanation while holding candidate sequences and goal semantics fixed.
Additionally, as far as I understand it, the intervention changes the planning objective, not just the frame at which a reliable prediction is read. For reasons potentially beyond improved ranking resolution, can't that favor different trajectories?
The evidence for improved success also seems mixed. The rule improves success by 3–5 percentage points, but the gain is statistically significant only on Reacher. The abstract mentions a broader “three to fifteen points” range, which appears to include other variants so it should distinguish those results from the blind rule’s gains.
All experiments use 1 pretrained model, 1 search method, and 4 simulated environments so broad generality remains largely untested. The horizon manipulation is limited to two tasks, and the paper does not directly test the proposed mechanism on e.g.MPPI, iCEM, another model checkpoint, or real-robot data. I believe to be acceptable for ICLR, this should be extended to include at least some of these, to be able to better support better the more general claims in the paper.
Questions for authors
-
In the horizon-manipulation experiments, is the goal embedding still the frame 25 environment steps after the start, or is the goal redefined for each horizon?
-
Can the authors test the effect of changing the queried frame while evaluating the same fixed candidate sequences, to separate target-frame effects from changes in CEM’s search distribution?
-
How much offline environment interaction is needed to estimate a reliable resolution curve, and how sensitive is the selected frame to the particular candidate set used for that estimate?
We have updated the revised pdf
Dear Reviewer XCFs,
Thank you again for your constructive feedback. The corresponding revisions are highlighted in red, incorporating the additional experiments and clarifications discussed in our rebuttal.
The main updates addressing your concerns can be found in:
These additions place the goal definition, the fixed-candidate comparison, the horizon length, and the model coverage in the corresponding parts of the paper. If this answers your questions, we would be sincerely grateful if you would consider raising your score.