- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes the Cognitive Map World Model (CMWM), which explicitly incorporates the Abelian group structure of spatial actions into a world model. Inspired by grid-cell phase coding, the model encodes spatial actions as phase shifts across multiple periodic modules and aligns the latent representation of observations with these phase shifts. This enables direct prediction of future observations without autoregressive generation. To support navigation, the authors propose estimating relative displacement between two observations by solving a congruence problem. Experiments show improvement over the autoregressive and MaskGiT baselines.
Critical strengths
-
The proposed framework is mathematically well-motivated, and the closed-form latent alignment solution is particularly compelling.
-
CMWM avoids autoregressive generation using an explicit, structured latent dynamic. This is an insightful idea that could improve computational efficiency substantially
Critical weaknesses
- Does multi-periodic phase encoding really have empirical advantages? Although App 4 includes several ablations, they all assume multi-periodic phase encoding and modify the design on top of it. In particular, the core computational advantage of directly predicting distant future states from accumulated actions does not inherently require multi-periodic encoding. Therefore, I wonder whether multi-periodic phase encoding has empirical benefit over a non-periodic additive latent representation (which could have the same computational advantage).
Questions for authors
None
2 comments
Dear Reviewers,
The authors have addressed your comments in their rebuttal. Please review their responses and provide any further feedback or follow-up questions, if any. Thank you!
Best, AC
Response to Reviewer qaL7
We thank the reviewer for the positive assessment of the mathematical formulation and closed-form alignment. Your question identifies an important distinction: horizon-independent state prediction follows from explicitly composable dynamics; it does not inherently require periodic encoding. Our claim should therefore concern the empirical usefulness of the representation, not exclusive ownership of the computational advantage.
New representation ablations
We evaluated two additional variants of the phase-based model: a single-period representation, and eight modules with all translation periods enlarged by 14,000×. Both retain direct prediction from accumulated actions. We compare their results with the default configuration reported in Table 4:
The default representation exceeds the single-period and large-period variants by 7.01 dB and 6.29 dB in test PSNR, respectively. Because direct prediction is retained, these results indicate that its computational advantage alone is insufficient to explain the default model’s prediction quality. The eight-module control further shows that the number of periods alone does not explain the improvement: their spatial scales matter.
A plausible explanation is the balance between spatial sensitivity and range. A single period can introduce position ambiguity over repeated cycles, whereas greatly enlarged periods reduce local phase changes: Eq. (1) gives a 14,000-fold smaller phase increment for the same translation. Multi-scale coding combines locally sensitive modules with longer-range information. The results are consistent with this explanation, but do not independently establish its causal mechanisms.
Scope of the conclusion
The large-period variant probes a low-frequency phase representation; it is not equivalent to an unconstrained non-periodic additive latent model. We therefore do not claim that these experiments establish universal superiority over additive representations. They provide evidence for the original multi-scale configuration within CMWM, while a matched additive-latent baseline remains an important comparison.
We will add these results and explicitly distinguish the benefits of composable dynamics for direct prediction from those of multi-scale phase coding for representation quality.