- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The manuscript studies world models that share "common structural organization", which seems to be about sharing high-level structure with differing low-level dynamics. The authors then propose, test a model tailored to modeling this class of systems, and develop theory that provides some guarantees about them.
Critical strengths
- Studying methods that exploit structure in dynamical systems (which this paper does) I believe is often-overlooked with lots of potential.
Critical weaknesses
- There are severe presentation issues with the manuscript. E.g., technical terms like "organization structure", "event-update families", "flow", are not defined; equations 1 and 2 are the same. The Develop operator is undefined and not explained, even though it is seemingly a core operation. As another example: the manuscript focuses on "heterogenous" world models. What is exactly meant by this? The word is in the title, but it is used only in the introduction and the conclusion and it is never explained what this refers to.
- The connection between the main theorems and the manuscript's stated goals are not described. Similarly, the connection between the theorems and the experiments is not explained clearly. This puts a heavy burden on the reader for understanding what the contribution is and how the different sections form a coherent whole. This makes it hard to assess what exactly the experiments are testing relative to the setup described in the theory.
Questions for authors
- Would you consider formally defining the manuscript's core terms? E.g., "heterogenous worlds", "mature dynamics", "organization structure", "behavioral meaning", etc. This would clarify a lot of the manuscript.
- Would you clarify the connection between the stated goal, the main theorems, and the experiments?
- Would you clarify what the insights from the theorems are?
Response to Reviewer zzuk We thank the reviewer for the detailed comments on clarity and presentation. We have revised the definitions in Section 2 and strengthened the connection between the theoretical results and experiments.
W1 and Q1. Definitions of the central concepts. A: Heterogeneous worlds are environments with different behavioral distributions, temporal dynamics, action responses, and observations. They share the DWM model structure but learn separate parameters from their interaction data. The continuous flow describes state evolution between events; the event map describes the change caused by a realized action. Mature dynamics are the fitted parameters obtained through Development. The behavioral meaning of a latent direction is determined by its effect on action probabilities and its response to actions. Section 2 defines the model, while Section 4 and Appendix D.6.2 illustrate these quantities in the learned dynamics.
W1. Difference between Eqs. (1) and (2). A: Equation (1) defines the original event time transition through F(e) and g(e). Equation (2) constructs a continuous flow and event map whose composition reproduces that transition. Theorem 2.1 also transforms the behavior model consistently, establishing equivalence of the resulting trajectory distributions under its assumptions. Equation (1) specifies the process; Equation (2) gives the representation used by DWM. Appendix C.10 contains the derivation and identification analysis.
W1. Definition of Develop. A: Develop maps an initialized model and its training data to a fitted dynamical model. Training proceeds from observed trajectories toward autonomous generation. Each stage evaluates a candidate using held out autonomous prediction and stability certification. An accepted training duration is replayed on the full training data, and the certified model becomes the parent of the next stage. Equation (12) specifies the acceptance rule; Eq. (13) defines the composition of stages. Appendix B.1.4 gives the implementation. Affine calibration subsequently adjusts scoring probabilities without changing the generated trajectory.
W2 and Q2. Connection between theory and experiments. A: Theorem 2.1 motivates the continuous flow and event maps that we fit and analyze experimentally. Theorem 2.2 gives the fixed event path contraction property assessed through developmental certificates and the independent audit in Appendix D.6.3. Theorem 2.3 establishes that stage selection preserves the certified model class; Section 3.4 examines how the accepted stages affect prediction and dynamics. Section 4 and Appendix D.6.2 connect the fitted state to behavioral coefficients, action responses, and subsequent evolution.
Q3. Insights from the theorems. A: Theorem 2.1 establishes a representation in which continuous evolution and the effect of actions can be examined separately. Theorem 2.2 combines contraction between events with the effect of event updates. Appendix C.11 extends the analysis to the autonomous transition kernel, accounting for state dependent action probabilities. Theorem 2.3 establishes preservation of the certified model class during Development. Together, these results explain the model's mathematical construction, stability properties, and learning procedure. The experiments investigate how these properties appear in fitted models. We appreciate the reviewer's suggestions, which have made the relationship between the equations, learning procedure, and empirical analysis clearer.