- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper introduces PoleWM, a direct visual world model that decomposes a learned latent trajectory into an initial-condition response and delayed, action-conditioned responses. Nonlinear action-prefix networks generate response coefficients, while a shared, learned pole basis determines their temporal evolution. The construction enforces initial-state anchoring and non-anticipation and gives bounded responses for a fixed finite plan. The model predicts visual embeddings and is evaluated through CEM image-goal planning on Cube, TwoRoom, PushT, and Reacher, alongside an early prediction-head comparison and a separate planning-latency study.
Critical strengths
-
The idea of explicitly organizing action effects over time is interesting. Separating response content from elapsed-time evolution provides a concrete inductive bias for direct prediction. The structural analysis also carefully distinguishes anchoring, non-anticipation, and boundedness from the stronger requirement of restart consistency. This makes the proposed architecture and the scope of its guarantees understandable.
-
The complete-system results provide encouraging evidence of practical value. PoleWM reaches 90.83% mean planning success, compared with 84.75% for the strongest baseline mean, and leads on three of four tasks. A separate timing experiment demonstrates that the analytic predictor can be used at practical latency inside CEM. These results support further investigation of the design.
Critical weaknesses
-
The empirical justification for the added temporal prior, especially the pole parameterization, remains incomplete. The controlled head comparison is restricted to Cube, one training seed, and the first training epoch. At epoch 1, the direct, neural-response, and pole-response heads reach 56.33%, 77.00%, and 79.67%, respectively. The larger observed gain therefore comes from response organization, while the additional gain from poles is smaller. This is useful early-training evidence, but it does not establish whether either advantage persists after full training or as data and model capacity increase. The classical response analogy also does not by itself establish that a learned visual latent admits this restricted temporal form. Joint representation learning could make the prior appropriate, but the structural propositions characterize the chosen architecture rather than demonstrate its predictive suitability. I would like a more complete head comparison to justify the added structure and clarify the contribution of poles.
-
The evaluation scope limits the evidence for broader applicability. The four benchmarks involve relatively simple goal-reaching tasks, use a from-scratch ViT-Tiny encoder, and evaluate short control episodes. These are useful settings for testing the idea, but provide limited evidence that the latent response prior remains beneficial under more complex dynamics or visual conditions. The overlapping-window split allows windows from the same episode in both training and validation, and control task pools were reused during development. The paper appropriately acknowledges that this does not establish trajectory-held-out generalization. Nevertheless, the current evaluation leaves my main concern about the applicability of the prior unresolved; an independent held-out evaluation would strengthen the evidence.
Questions for authors
-
Do the direct, neural-response, and pole-response differences persist after full training and across training seeds or tasks? If such results are available, please report them and clarify model-capacity and training-compute differences. This would materially affect my assessment of the value of response organization and the pole basis beyond early optimization gains.
-
How are the control evaluation tasks separated from the training episodes and the pools used during development? Are there results on an independent held-out pool or trajectories that clarify whether the temporal prior generalizes beyond the reported protocol?