- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper presents different ways to learn cost functions between a latent goal state and an observed "state" in latent world models and MPC/CEM planning, as opposed to direct L2 comparison between these two. It introduces linear and non-linear costs for quadratic functions and tests it on toy problems.
Critical strengths
The paper IMO addresses the right angle in WM + MPC settings, namely the cost functions. Comparing latent states is probably one of the most critical current weaknesses in this setup.
Critical weaknesses
I would like to reassure the human co-authors of this paper that I did not use an LLM for my review and that thus their paper has not been uploaded to an LLM either. I see that as an advantage for the submitters, but it also comes with a downside: the paper needs to be understandable for a human.
PRESENTATION
The paper is very hard to understand since it is written as a collection of details. While technically there is structuring into abstract, introduction, method, experiments, the levels of abstraction seem to be identical in all of these section. All sections present the same (high) level of technical detail and so we jump from technical detail to technical detail all along. The paper reads like a technical report for a member of the team already very familiar with the work. For instance (I cannot cover all issues in this review),
- the abstract and introduction are written like experimental sections, full of details and results.
- the method section 3 does not even introduce the basic setting of latent WMs and MPC, it is supposed to be known.
- the method section mixes actual method and details on the experiments, frequently mentioning which kind of loss and distance is tested on which kind of problem.
The paper also contains claims which are probably true but heavily depend on assumptions which have never been specified. For instance, L075 "in navtio .... latent space suffices ...": this really depends on the kind of navigation problem addressed: what is input, what is output, is there a map or is this an agent in a 3D photorealistic environment?
There is lot of heavy language written in a highly detailed and non-standard way. Sentences with "deep" explanations are dropped in without context and I have a hard time understanding what is meant. Example: L190 "Training and validation pairs come from the same pool of source episodes, so validation loss measures fit within that pool." The sentence is understandable, but I don't understand what the authors want to say with this. This is clearly not really a desired behavior as the experimental setup does not require any OOD generalization, and "validation loss measures fit within that pool" is understandable but is not linked to any scientific motivation I could imagine.
It is a pity that the authors did not find a way to make use of the almost entirely empty last page.
NOVELTY
The setup tested in this paper is not novel. Learning temporal distances for goal reaching has been done in a large body of work, as also mentioned in the RW section. Comparing linear and non-linear costs has been done in the cited references (Li et al., 2026a) and Singh (2026). As mentioned, the contribution is the positive semidefinite quadratic cost. The conclusions however, stay very similar to the conclusions of prior work.
Section 3 is also written in way mixing contributions and existing work, it is not easy to understand what the authors claim.
What is the motivation of the factorized linear version? In the best case it is a low-rank linear variant with effect on optimization. The choice is not properly motivated.
The notation is hard to follow. why is there a d in from of unnormalized sum and no sum symbol (L145)? What is the s factor in L161? Why was a bias term introduced in L153 if it cancels out in equation (2)? While in L171 it is clear that \Sigma is the cov matrix, this should be introduced.
The experimental setup is not clear (section 3.3)
EXPERIMENTS AND RESULTS
The experiments are in line with the very simplistic experiments of the WM literature. While I do understand that sometimes overly simplistic environments (actually, "toy problems") can be justified to specifically test some particular line of promising models if a breakthrough is expected later, I think the community should rethink it's current view on world models. These kind of models are currently held in high esteem, which entirely contrasts with the toy problems they are capable of solving. The two environments covered in this work are good examples for this.
Beyond this remark, one has to ask the question what the take-home message of this work is, what did we learn from it? Other work has already provided evidence that linear cost functions can outperform non-linear ones in certain settings. However, what is the reason for this? In what settings can we believe this to hold? One of the most important (and bold) statements in this paper is "The frozen representation therefore supports a useful planning geometry, which temporal training of a linear cost recovers in these tasks. The linear cost also has practical structural advantages", L423. However, this is a universal statement and it potentially (and probably) depends on what "frozen" means, and what the task setup is, even for "navigation" tasks: is there a map, is there a state / position input, does it generalize to static point goal from photorealistic simulators or even to image goal? Generally speaking, which properties of a tasks do we rely on for this to hold?
SUMMARY
I will be upfront: the rebuttal is unlikely to change my opinion. My assessment is that the presentation alone makes the paper unsuitable for publication. Additionally, the experiments are performed on very simplistic tasks (which admittedly are somewhat standard in the WM literature) and the novelty is not high enough.
DETAILS
- L136 a_t should be a sequence of actions if it predicts z_T+H(a_t)
Questions for authors
See "weaknesses" section.
Additionally:
- Are training and validation split into different environments? Is there a test set?
- What is "Development success"? (Figure 3)
- What is "it in L351?
Thanks for the authors' rebuttal. The new experiments strengthen the empirical evidence and address several of my concerns.
However, my main concern remains: the paper shows that linear costs often work surprisingly well, but it provides limited insight into why this happens or when to expect it. As a result, I still view the contribution primarily as an empirical observation, so I will keep my original score.