- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes 3 progressively weaker equivalence relations for world models (mechanism/response/decision sufficiency) and aims at using them to analyze what a world model must preserve for planning. These ideas are tested on a collision system, a double pendulum, and two robotic pushing tasks, motivating a modular design where the planning objective guides candidate proposals but not outcome prediction.
Critical strengths
-
The main question is clean and well motivated. The proposed hierarchy itself is interesting and may be useful.
-
Several controls about the experiment design are careful:
- Encoders are frozen. A common scorer is retrained on top. So differences are because of retained information and not head capacity.
- Rates are measured from actual range-coded streams, not surrogates.
- The search-selection crossing in Push-T is genuinely nice: Full/Full=.180, Full/Decision=.179, Decision/Full=.691. It shows that information that is sufficient for final selection can fail during search. This is, in my opinion, the most convincing evidence for the claim that search is needing different information than selection.
Critical weaknesses
-
The theory is thin relative to previous works. Lemma 1 is quite standard argument. Decision & response sufficiency seem to be close to policy- and Q-irrelevance abstractions (Li et al. 2006) and value equivalence, only with being restricted to a finite candidate set. The authors have cited these but are in my opinion not precise enough about what's new here. Prop.1 is more a toy example than a general result. All this limits the theoretical contribution.
-
The mechanism-response-decision hierarchy is presented as the main contribution, but it is not used to organize the paper.
- It is used formally only in Sec.4.2 (collision).
- The pendulum (Sec.4.3): response-supervised rates are never reported, so response vs. decision is not compared.
- Sec.5 and Sec.6.1 use loose analogues (Cost vs. Decision messages, Value vs. Planner).
- Sec.6.2 discusses query placement extensively, but has nothing to do with the hierarchy.
- Mechanism sufficiency is defined but is never studied as such. The closest is the Known control in App. C.4, which is not analyzed in hierarchy terms.
Hence, the experimental part consists of 4 case studies that are loosely connected. Each has its own metric and normalization. Since the hierarchy is the main conceptual contribution here, its absence from most experiments is weakening the central claim.
- The headline design claim is small and confounded.
- Held-out regrets for ACWM, Joint and Modular are 0.164, 0.160 and 0.153 (Table 13), from 3 seeds, with no significance tests and unexplained error bars (Fig.8(b)).
- Modular has the most parameters of the three (4.80M vs. 3.80M ACWM and 4.36M Joint), and Joint+action, with 7.54M, beats everything, so capacity cannot be ruled out as the explanation for the ranking.
- The authors themselves say (ll.437-439) that the Joint vs. ACWM comparison confounds query placement with action exposure.
Since the Modular design is the main practical recommendation in the paper, these small and confounded effects leave it insufficiently supported.
Questions for authors
-
I have doubts about the novelty of the Modular design. A query-guided proposal plus a query-independent world model for evaluation seems to be what SAGE (Cheng et al. 2026, cited at ll.089-091) already does. Policy priors guiding planning over a learned model are also quite standard practice. How is your approach different?
-
What precisely is new relative to value equivalence (Grimm et al. 2020) and */Q-irrelevance abstractions (Li et al. 2006)?
-
The paper essentially juggles between two contributions: the hierarchy AND answering the question from Sec.6 on "how a world model should preserve it or where the query should enter". I think the paper would gain clarity and impact by focussing on one. Which of the two do you consider the main contribution?
-
What do the error bars in Fig.8 show? Can you report confidence intervals and/or apply significance tests for Fig.8?
-
Does Modular still beat Joint when parameter count are matched?