- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
ConceptWorldModel studies action-conditioned prediction using a hierarchy of grounded factors, relational slots, and higher-order representations. A frozen visual encoder provides features, thirteen annotated concepts supervise the grounding module, and a dynamics model recursively predicts future states. The evaluation uses Bench2Drive and includes concept forecasting, architectural ablations, and probes for three concepts excluded from direct supervision. The paper reports improved forecasting over adapted latent-dynamics baselines and different patterns of concept recoverability across representation levels.
Critical strengths
The paper addresses a useful question: how semantic information is organized and preserved in a predictive model. Separating directly supervised concepts from held-out probes gives the study a clear experimental focus.
Critical weaknesses
I am not convinced by the main baseline comparison. In Table 1, DreamerV3 diverges on every continuous-prediction horizon, while MILE already has an nMAE of 6.715 at the first step, compared with 0.410 for CWM. The idea of comparing dynamics models on a shared state is reasonable, but these results raise questions about the adaptations and optimization. The paper does not provide enough detail about the adapted objectives, output scaling, or training settings to rule out implementation or convergence issues. Until those issues are resolved, the large performance gaps are difficult to interpret. A stable simple recurrent predictor and a persistence baseline would also help establish how demanding this forecasting task actually is.
The evidence for hierarchical semantic dynamics is incomplete. Table 2 measures whether held-out concepts can be recovered from representations of observed scenes. Future rollout evaluation, however, measures only the thirteen directly supervised concepts. The paper therefore does not show whether the held-out semantic information remains recoverable after recursive prediction. The interpretation of the probing results also needs stronger controls: closing speed is derived from lead-distance history, and TTC is then computed from distance and closing speed. Recovering these quantities may reflect retention of lower-level information rather than a distinct benefit of the proposed hierarchy. Probes on alternative representations and uncertainty estimates for the small differences between levels would make this conclusion more convincing.
The comparison with recent work is not sufficiently convincing. Although Section 2 discusses driving world models from 2025–2026, the experiments are limited to adapted versions of MILE, TD-MPC2, and DreamerV3. It remains unclear whether these comparisons adequately represent competitive approaches to the proposed task, particularly given the numerical divergence of DreamerV3 in Table 1. The authors should better explain their baseline choices and provide stronger, task-matched comparisons. The distinction from existing concept-based and relational modeling approaches also needs more concrete discussion. Taken together, these gaps leave me unconvinced that the paper has sufficiently established either its incremental novelty or its empirical advantage.
I lean toward rejection. The research question is worthwhile, and some of the architectural controls are useful. However, the main performance comparison relies on baselines whose training behavior is not adequately explained. At the same time, the semantic analysis does not establish whether held-out concepts remain accessible during future rollouts. These gaps affect the central claims of the paper.
Questions for authors
What changes were made to DreamerV3, MILE, and TD-MPC2 for the controlled comparison? Please explain the divergence in DreamerV3 and MILE’s large one-step error, including the relevant losses, normalization, and convergence checks.
Were the held-out probes evaluated on recursively predicted states, or only on observation-encoded states? If results on predicted states are available, please report them across rollout horizons using the same frozen probes.
Please clarify the probe training and model-selection splits, and report uncertainty for Table 2. Are comparable probe results available for the flat representation or frozen visual features? Also, what duration in seconds does the 20-step horizon represent?
The authors have not yet responded; therefore, I will maintain my original score.