- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper investigated the representational geometry of diffusion-based world model activation (NWM in particular) across different time steps in a trajectory and found a loop-like structure, which the authors interpreted as a navigation-relevant learned spatial structure. Motivated by the instability of loop-like structure across layers, a path integration component relying on structured transitions between multi-scale grid modules was introduced. The modification improved the stability of loop-like structure across layers and improved the generation and navigation performance over the baseline. The necessity of each proposed component is demonstrated through ablations.
Critical strengths
- The result of persistent homology analysis provides an interesting perspective on the representational geometry supporting diffusion-based world models' navigation capacities.
- The proposed architecture achieves consistent improvements in visual prediction and navigation performance over the original NWM across multiple real-world navigation datasets. The improvements in long-horizon prediction are particularly encouraging.
Critical weaknesses
Major Weakness
1. Forced connection between latent loop structure and “cognitive maps”.
The latent loop could reflect visually contiguous features across trajectory time steps rather than spatial structure. Although the authors use Fig. 3 to support spatial encoding, their perturbation disrupts both spatial and visual continuity, making it impossible to disentangle the two explanations. Moreover, visual encoding could equally explain the correlation between latent-loop structure and navigation performance: degraded visual representations could simultaneously weaken the loop structure and impair navigation performance. The authors should introduce controls that disentangle spatial encoding from visual encoding.
2. The connection between the representation analysis and the introduced model components seems forced.
Even if the latent loop encodes spatial structure, the introduced component feels like a generic HPC–MEC-inspired architecture rather than one specifically motivated by the observed latent topology. In particular, it is unclear how the observation of an unstable loop structure motivates the specific grid–place dynamics introduced in the model. The improved stability of the latent loop across layers is an empirical consequence of the proposed architecture rather than something guaranteed by construction. The authors should better establish the mechanistic connection between their representation analysis and architectural design.
3. The use of Isomap is insufficiently justified.
The authors state that “Isomap helps preserve intrinsic geodesic structure when the latent states lie on a curved manifold.” However, persistent homology can already be applied directly to high-dimensional point clouds, including those sampled from curved manifolds. Furthermore, Isomap modifies pairwise distances and could alter the resulting topology. Can the authors apply the same analysis directly to the original latent representations, or to PCA-reduced representations without Isomap, to demonstrate that the observed loop structure is not an artifact of dimensionality reduction?
4. Fig. 1 contains points with death times smaller than birth times.
In the persistence diagram, why are there points with death < birth? By construction, death ≥ birth in persistent homology. Can the authors clarify whether this is a plotting error or whether a different convention is being used?
5. The choice of persistence threshold = 0.1 is unjustified.
Why was = 0.1 selected as the threshold for significant loop-like structures (L954)? It would be more convincing if the authors visualized the low-dimensional representations (as in Fig. 1) for samples with persistence around = 0.1 to demonstrate that this threshold meaningfully distinguishes loop-like structures. A sensitivity analysis across different thresholds would also strengthen the justification.
Minor Weakness
6. The interpretation of Fig. 7 is questionable.
Although the reported correlation between H1 persistence and navigation error is interesting, most samples have persistence values below the authors' threshold of = 0.1. By their own definition, these samples do not exhibit significant loop-like structure. Therefore, while the correlation itself is statistically valid, it does not necessarily support the claim that stronger cognitive-map-like representations lead to better navigation performance (L429–430). Furthermore, as mentioned in Weakness 1, visual prediction quality could explain both stronger persistence and lower navigation error. The authors should examine whether the correlation remains robust after controlling for visual prediction quality and across different persistence thresholds.
7. The claim in L215 is premature.
The authors state that “The analysis above links latent topological organization to navigation performance.” However, none of the analyses in Section 4 directly establishes this relationship. The relevant correlation analysis is only presented later in Section 6.3 (Fig. 7). The authors should either revise this claim or explicitly refer to the later analysis.
Questions for authors
1. Unclear which hidden states are used for the representation analysis (L148–150).
At which diffusion step are the hidden states extracted? Or are the activations aggregated across diffusion steps? Although the appendix mentions intermediate diffusion steps, the exact procedure remains unclear. Additionally, what does the 16-second horizon (64 latent states) mean in this context? How is each latent state represented as a point in the persistence analysis? Can the authors clarify?
2. Unclear distinction between generation and navigation (L150–151).
The authors define generation as action-conditioned direct generation and navigation as continuous autoregressive rollout. Does this mean that generation uses ground-truth context throughout, whereas navigation conditions on the model's own predictions from earlier trajectory steps? The authors should clarify the precise experimental distinction.
3. Insufficient characterization of the consistency of the latent loop structure across trajectories.
Fig. 1 and Fig. 2 show single examples. Although Appendix E.7 reports statistics across 60 random samples, the reported fraction of layers exceeding the persistence threshold does not fully characterize how consistently the loop structure emerges across trajectories. Can the authors report the distribution of maximum H1 persistence across trajectories and visualize representative samples with different persistence levels?
13 comments
- Sensitivity analysis of the persistence threshold (Weakness 5)
For sensitivity to the persistence threshold, we vary the threshold and obtain the following results:
| Threshold τ | Generation: NWM | Generation: Ours | Rollout: NWM | Rollout: Ours |
|---|---|---|---|---|
| 0.050 | 20/28 (71.4%) | 23/28 (82.1%) | 16/28 (57.1%) | 16/28 (57.1%) |
| 0.075 | 15/28 (53.6%) | 17/28 (60.7%) | 14/28 (50.0%) | 15/28 (53.6%) |
| 0.100 | 10/28 (35.7%) | 14/28 (50.0%) | 9/28 (32.1%) | 12/28 (42.9%) |
| 0.125 | 5/28 (17.9%) | 11/28 (39.3%) | 5/28 (17.9%) | 7/28 (25.0%) |
| 0.150 | 5/28 (17.9%) | 8/28 (28.6%) | 5/28 (17.9%) | 5/28 (17.9%) |
| 0.200 | 3/28 (10.7%) | 4/28 (14.3%) | 2/28 (7.1%) | 2/28 (7.1%) |
- Interpretation of Figure 7 (Weakness 6)
Figure 7 uses maximum persistence as a continuous metric, whereas 0.1 is used in other experiments to compute the proportion of layers exceeding the threshold. The correlation analysis between continuous scores and ATE can include samples below the threshold. The figure directly supports the statement that ``continuous topological strength is correlated with trajectory error.''
To examine whether the association in Figure 7 can be explained by differences in visual prediction quality, we compute LPIPS between the predicted frames and corresponding ground-truth frames for each trajectory and average it over time to obtain a per-trajectory visual prediction error. We then use this error as a control variable in a partial correlation analysis between persistence and ATE. After controlling for visual prediction error, the partial correlation coefficient is , indicating that the association remains negative.
- The opening statement of Section 5 (Weakness 7)
We thank the reviewer for pointing out this ambiguity. Section 4 primarily analyzes latent topological features and their stability across layers, whereas the correlation analysis between persistence and navigation error is presented in Section 6.3 (Figure 7). We will revise the opening transition sentence of Section 5 to explicitly reference this analysis and distinguish the representation observations in Section 4 from the performance-association results in Section 6.3.
- Hidden-state extraction procedure (Question 1)
The current extraction setup uses the 125th model call among 250 reverse sampling steps. We average the output of the specified CDiT layer over the image-token dimension to obtain a 1152-dimensional vector, which serves as the state point for that prediction time. The current image configuration corresponds to 196 tokens. A 16-second horizon corresponds to 64 prediction times at 4 Hz. With the network layer and diffusion step fixed, the 64 state vectors from the same trajectory form a point cloud. The analysis is then repeated for the other network layers.
- Difference between generation and navigation (Question 2)
In the representation analysis, direct generation always uses the same initial ground-truth observation context and separately predicts future time points using the corresponding action and time conditions. In the autoregressive setting, each newly predicted frame is added to the context, and the earliest frame is removed, so subsequent predictions depend on previously generated results. Both settings are action-conditioned; the difference is whether the context is recursively updated.
- Additional persistence diagrams (Question 3)
Appendix E.9 of the paper presents additional examples, dimension-reduced representations, and persistent homology plots for both generation and navigation.
If our response has addressed your concerns, we would appreciate it if you could reconsider your overall assessment of the paper.
We thank the reviewer for recognizing the value of the paper's analysis and method, and for raising specific questions about the experiments and presentation. Our responses to each question are provided below:
We clarify that Section 4.3 examines the role of correct context--action--future-target relationships in latent representations. Following this intervention, both performance on the correct test set and the latent loop-like structure deteriorate, indicating that the observed structure depends on consistent correspondences within the task. This provides evidence of navigation relevance. To address your further question about distinguishing spatial factors from visual and temporal factors, we conduct an inference analysis using the existing frozen NWM, keeping the ground-truth context of each trajectory fixed. The first group receives the correct actions; in the second group, the action conditions are replaced with actions from other trajectories in the same scene with similar durations and action magnitudes. We compare the latent-space trajectories under these two settings for 20 RECON trajectories. We find that replacing the actions causes only a slight performance degradation, and the latent-space trajectories do not exhibit the collapse observed in Section 4.3. We speculate that this is related to the model's out-of-distribution generalization capability; our experiment reflects an association between visual encoding and latent structure. We will explain the limitations of the original experiment and add the subsequent conclusions in the revised Section 4.3.
The representation analysis directs our attention to state consistency during prediction: loop-like organization appears in some layers of the original model, but this organization changes with network depth and autoregressive prediction. The architecture therefore introduces explicit action-update rules, constraining the evolution of the additional spatial conditioning by displacement. Specifically, the perceptual history establishes a place representation, the place-to-grid mapping determines a discrete state, and actions advance the state through periodic permutations. The updated state is then mapped back to spatial conditioning and supplied to the frozen backbone. Different periods encode displacement over different ranges; environment-dependent projections distinguish the interpretations of the same periodic state in different scenes. The observed latent loops motivate the design, while the roles of the components are tested through ablations. In Table 4, the full method achieves an ATE of 0.959, compared with 1.023 for identity transitions, 1.016 without remapping, and 1.059 for the generic MLP. These results support the roles of the specific dynamics and mappings. The periodic boundaries and permutation rules are internal constraints of the module, whereas the increased persistence of the backbone's hidden representations is an empirical result.
Isomap is one of the choices in our original analysis pipeline, intended to preserve geodesic distances on the latent manifold and thereby preserve its structure. We vary these dimensionality reduction methods and parameters using the same trajectories, network layers, and diffusion step. The results are shown below:
Bold indicates the parameters selected for our method. Although the computed persistence values vary across parameter settings, they all exhibit the same trend.
The plots use birth scale and persistence lifetime as their coordinate convention, with the vertical axis representing death scale minus birth scale. Labeling this axis as Death was an error. Under this convention, a vertical coordinate below the birth scale does not imply that the original death scale is below the birth scale. We will correct the vertical-axis label to persistence lifetime and explain this in the figure caption.