- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
World models encode the previous information in latent representation. The authors exploit this fact to investigate where the information is memorized and saved in the model. Three diagnostics of stable retention, interventional causal separation, and causal-subspace Lyapunov factor are proposed to examine the memorization.
Critical strengths
World models are attracting interest in the research community, and the research direction is a timely topic. The research question in terms of memory is interesting, and several experiments, including JEPA, were performed.
Critical weaknesses
- The causal separation test may be trivial; the direction of the counterfactual difference is removed to yield the same trajectories. As the authors noted, this observation can arise by construction, irrelevant to the memory mechanism. Other experimental designs could be considered.
- The definition of memory in this study measures the distance of two trajectories. Strictly speaking, this definition is different from keeping recovery for information of previous events. For example, different trajectories can yield similar latent distributions. I encourage the authors to validate the memory definition works in experiments.
- The authors used the Lyapunov norm in Eq. 5 with the intention to measure direction and magnitude. However, the Jacobian can rotate v in the other direction while keeping the norm. Other designs could be considered.
- Stable retention is defined in Eq. 2. This definition regards exponential expansion, which is literally unstable, as stable. In other words, Eq. 2 does not reflect exponential expansion, such as g(z)=1.1z.
- The training objective in Eq. 1 has a trivial minimizer with L=0 if f=0 and g(0)=0. In other words, there exists a solution of a constant encoder with no memory to minimize the training objective. Auxillary design to prevent this solution could be considered.
- Writing should be improved:
- "holding predictor” → “holding the predictor architecture” would be correct as it is trained.
- “the same model” → “the same encoder configuration” would be correct as it is trained.
- “Per-seed values for every aggregate are in Appendix F.” → this was not fully reported.
- “dynamical memory is parameter-free” → dynamic memory still uses a learned predictor parameter. The intention would be no need for recurrent-state mechanics.
- “all metrics use l_2” → others were actually used, such as cosine similarity.
- Cho et al. (2014) and Hochreiter & Schmidhuber (1997) were listed in references but not cited in the manuscript.
- “tasks with recommended disclosure” → should be explained cleanly.
- Figure 1 → Possibly AI-generated figure. They are acceptable but could be further enhanced.
Questions for authors
See the weakness above.