- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies long-horizon prediction in learned physical dynamics, focusing on why models with similar one-step errors can exhibit substantially different rollout behavior. The authors analyze this through the finite-time transport of local residuals and distinguish three factors in autoregressive dynamics: temporal representation, forward exposure, and temporal credit. They compare a direct finite-time transition model with generator-based dynamics across multiple physical systems and show that the direct transition formulation achieves better long-horizon prediction despite not consistently improving one-step accuracy. Additional matched-credit and credit-depth experiments suggest that the advantage is primarily due to the temporal representation rather than differences in rollout exposure or backpropagation depth. Overall, the paper argues that long-horizon performance should be evaluated through the geometry of repeated composition rather than inferred from local prediction error alone.
Critical strengths
- The core idea is novel and conceptually well motivated.
- The paper is generally easy to read and follow, and the main intuition is communicated clearly.
Critical weaknesses
- The overall writing and presentation structure has several issues, which makes the contribution feel less sharply organized than it could be.
- The core contribution currently feels somewhat limited in scope. The paper identifies one main phenomenon and builds the learning framework around that observation, but the contribution beyond this central finding is relatively modest.
- The related-work discussion also appears too limited. The number of references is relatively small, and several relevant lines of literature seem to be missing or only briefly acknowledged. In particular, the introduction should provide a broader and more systematic discussion of prior work on long-horizon prediction, autoregressive rollout error, learned physical dynamics, and finite-time versus infinitesimal dynamics. Strengthening the literature review would help clarify the novelty and positioning of the paper.
Questions for authors
Could you improve the presentation of the technical material? Important notation, assumptions, and theoretical details should be stated clearly in the main text and then supported by appropriate references to the appendix. Simply giving a brief explanation in the main text and deferring most of the substance to the appendix does not work well here. The core idea and overall construction are interesting, but the writing occasionally feels fragmented and overly template-like.
- I suggest reorganizing Section 3 into a more theorem-like structure, with clearly stated propositions/lemmas and proofs moved to the appendix or placed after the corresponding statements. In its current form, the section is difficult to parse.
- Equation (10) does not seem to be used later in the paper. If it is not essential to the subsequent development, I do not see why it needs to be stated in the main text.
- I also found the transition from Section 3 to Section 4 insufficiently motivated. In particular, the decomposition into the three components introduced there does not feel natural from the preceding analysis. The paper should explain more clearly why these three factors are the appropriate axes of comparison and how they arise from the theory developed in Section 3.