- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes HORME, a framework that models relational evolution using pair features for motion computation, rather than simply fitting trajectories. It introduces RA-JEPA to predict how each pair feature changes relative to the initial state of a window and supervise these predictions by matching them with encoded observed states on a pairwise basis. It also introduces TRD to compensate for displacement errors caused by the timing of acceleration within a step, using a learned correction term applied only to position without modifying velocity updates. These two components are connected through forecast conditioning. On both the I-PHYRE and N-body benchmarks, HORME achieves the lowest trajectory RMSE compared to baselines such as NFF, and ablation studies demonstrate the necessity of both RA-JEPA and TRD.
Critical strengths
-
Strong performance. The method clearly outperforms the baselines on both I-PHYRE and N-body experiments.
-
Effective combination of existing ideas. Although the individual components build on prior work, the paper effectively combines existing components to improve performance. The ablation studies also clearly demonstrate that both RA-JEPA and TRD are necessary.
Critical weaknesses
-
Unclear contributions of physical constraints and the proposed model on the N-body dataset. The effects of invariant inputs and antisymmetric readout are not separated from those of the proposed model. In particular, the model shows strong performance on N-body, but it is unclear whether this improvement comes from the two proposed modules (RA-JEPA and TRD) or from the physical constraints (invariant inputs and antisymmetric readout) that are not included in NFF. Therefore, an ablation study without these constraints is needed.
-
Lack of experiments validating the physical accuracy of pairwise force decomposition. The paper only shows improvements in overall performance, without demonstrating whether the identifiability problem mentioned in the introduction has been resolved. Experiments are needed to show that the learned pair features are physically accurate.
-
Writing clarity. Overall, the paper lacks consistency and is difficult to follow, making it hard to understand the main points. The introduction does not clearly present the key ideas, the related work section lists previous studies without discussing their relation to HORME, and many parts of the method section are unclear. The conclusion also repeats the abstract. The following are specific unclear points in the methodology:
-
R_φ is not defined, and the operations of “stores” and “query projections” are not described. The construction of the P_θ query, the mapping from the bank to K/V, and the encoding format of u_k are not described. The differences between the encoders used for each benchmark are not explained in detail.
Questions for authors
-
The model shows particularly strong performance on N-body compared to other baselines, and I would like to see a more detailed analysis of the reasons behind this improvement. What would the results be if only RA-JEPA and TRD were applied without invariant inputs and antisymmetric readout on N-body?
-
Contribution of RA-JEPA. The claimed contribution of RA-JEPA is that it correctly learns individual interactions by predicting changes in pair features. However, Section 4.3 only shows that the predicted features are 9–14% closer to the encoder outputs than the zero-change baseline. This demonstrates self-consistency between the predictor and encoder, rather than providing evidence that the features contain physically accurate relational information. Since pairwise forces can be obtained from the simulators in both benchmarks, I would like to request experiments that either (a) compare the pairwise contributions of the head with the actual pairwise forces or (b) compare HORME and NFF using a probe that reconstructs pairwise forces from pair features. In addition, the MAE in Figure 2(c) does not distinguish between direction and magnitude errors, and the only baseline is zero-change. Please report R² or cosine similarity and norm ratios separately, and include stronger baselines such as linear extrapolation.
-
Comparing Row 2 of Table 3 (TRD ✓, RA-JEPA ✗) with Row 1 of Table 4 (Auxiliary-only JEPA: TRD ✓, RA-JEPA predictor and prediction loss ✓, conditioning ✗), adding only the prediction loss without conditioning leads to worse performance on both benchmarks (I-PHYRE Cross: 0.119 → 0.126, N-body Cross: 0.685 → 0.943). A common assumption in this line of research (Section 2.2) is that an auxiliary latent prediction loss improves shared representations, but the results here show the opposite. This suggests that (i) the pair feature prediction task may push the shared encoder in a direction that is unfavorable for physical computation, and (ii) an explanation is needed for how conditioning resolves this conflict. The paper does not discuss this comparison. I would like to hear the authors’ interpretation of these results.
-
Please clarify the unclear parts of the methodology mentioned in Weakness 3.