- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors introduce a neurally inspired world-modeling framework where the recurrent dynamics are pre-trained path integrators known to produce grid-cell-like dynamics, and then memories are attached to these dynamics during inference to provide a structured latent scaffold. The precise methods appear to not be described in the paper, making it hard to describe more technically.
Critical strengths
While the paper is linguistically well written and clear, it is lacking in technical detail (see weaknesses). Despite this, the motivation and related work are very well specified and the main text is engaging and well-described.
The results are promising and the concept is reasonable.
Critical weaknesses
The major critical weakness of the paper is a lack of technical detail in the main text (and appendix) which makes the paper non-reproducible and difficult (or impossible) to judge reliably -- despite there being ample additional space left to include it (the paper is only 8 pages, far below the limit of 9).
For example, the Figure 1 overview is the closest thing that we have to a complete architecture description. There are some vague RNN equations in the appendix A.8, but the 'router', 'planner', decoders and encoders are never described, along with their training recipes. Unfortunately a comprehensive review of this paper cannot be completed without this information.
I recommend the authors include the full model description in technical detail, including training and evaluation in main text to provide more concrete grounding to readers as they try to understand the model. Furthermore, the symbols used in all of these equations are not anywhere defined. As another example of a lack of clarity, the precise definition of what a 'joint' trained model is (and how it is initialized) is never described in the main text (and I could not find it in the appendix properly described) despite this being the main baseline. Overall, the paper would be significantly improved by increased technical depth throughout.
The authors need to explain their model and experiments more properly and carefully before this is ready for acceptance.
Questions for authors
-
If it is known that you would like a specific set of grid-cell-code-like modules, why do you bother with pre-training them, instead of just analytically pre-specifying them? Have you experimented with the difference in performance between these alternatives, or additionally how performance changes if you unfreeze the RNN component after the pretraining phase?
-
Can you provide a complete description of all of the architectural components of your model, and the baselines, and their training procedures? Specifically, for your model, what are the details of the router, 'planner', decoders and encoders? These should be described with equations, layer structure, and dimensions at a minimum.
Reproducibility, analytic dynamics, and unfreezing
Reproducibility and model design
We thank the reviewer for the constructive suggestions, which motivated two important new experiments and substantial improvements to the implementation details. We have expanded §3 and Appendix B to specify the architecture, transition operators, initialization, training objectives, and hyperparameters.
The model uses an observation encoder and learned router to initialize the scaffold from the first observation and convert subsequent actions into module-specific controls. Frozen keeps the pretrained path-integration dynamics fixed; Joint trains the same architecture from random initialization; and Unfrozen init fine-tunes the pretrained recurrent dynamics alongside the interfaces. These comparisons help distinguish the effects of structured initialization, freezing, and downstream adaptation.
New analytic dynamics and unfreezing experiments
Following the reviewer's suggestion, we introduced an analytic operator implementing exact phase translations across eight scales, eliminating recurrent pretraining (§3, Eq. 2, Appendix B.3). With the same learned interfaces, Analytic achieves a 300-step path-integration error of 0.214 cm versus 41.369 cm for Frozen (Appendix C.1, Fig. 14, Table 10). At 4,096 trajectories, it also achieves 95.7% Language 3D OOD open-loop accuracy versus 42.0% for Frozen. However, Frozen performs better in OOD planning (57.7% versus 16.0%; Table 12), suggesting that accurate phase integration does not necessarily translate into better goal-directed planning.
We also directly tested whether freezing is necessary by fine-tuning the pretrained RNN with matched interfaces and training budgets across 16 data sizes and three seeds. At 1,024 trajectories, Unfrozen init improves Language 3D OOD cross-entropy from 0.779 to 0.710 and reduces imagined goal distance from 9.12 to 4.20, while the change on 3D Shapes is small relative to seed variation (Appendix C.4, Table 17).
Together, these experiments suggest that the key benefit lies in the structured dynamical prior rather than freezing itself. The prior can be supplied analytically or through pretraining, and fine-tuning can further improve performance depending on task demands.
Architecture and training clarification
We now provide complete specifications in §3 and Appendix B (Tables 5–9, Algorithms 1–3). The scaffold contains eight independent 512-unit ReLU modules, pretrained on 20-step path-integration trajectories using displacement inputs and phase-prediction loss. Analytic replaces these recurrent updates with exact phase translations. A shared router learns module-specific initial phases and action controls, and a decoder predicts observations from the combined latent state.
Training uses free rollouts: only the first observation is encoded, recorded actions drive subsequent transitions, and predictions are supervised at each step using cross-entropy or MSE (Eq. 4). Planning uses a learned action scorer and candidate-sequence search, with additional optimal-action supervision in Language 2D (Appendix B.7–B.8). Full network dimensions, hyperparameters, and matched baseline specifications are provided in the appendix.
We appreciate the reviewer's constructive suggestions, which helped us strengthen the study. Our results now provide clearer evidence that structured multiscale dynamics offer a powerful inductive bias for learning predictive world models, with benefits across different implementations and training strategies.