- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper extends ST-JEPA by introducing an auxiliary ranking loss between observation histories sampled at different cadences but sharing the same endpoint. A cadence-conditioned projector is used to establish correspondences between these histories. Experiments show that Takens-JEPA effectively improves cross-cadence transfer performance over ST-JEPA.
Critical strengths
-
The evaluation problem is clearly defined and meaningful. Cross-cadence transfer for scientific inference is a concrete problem with practical relevance, and learning correspondences between endpoint-aligned histories through an auxiliary ranking loss is a reasonable design.
-
The paper presents experiments across multiple physical systems and downstream tasks, together with several ablations. The results provide convincing positive evidence for the effectiveness of the proposed method over ST-JEPA in several settings.
Critical weaknesses
-
My main concern comes from the Multi-Cadence ST-JEPA ablation. Simply applying predictive pretraining at multiple cadences already recovers a large portion of the cross-cadence improvements. On Active Matter parameter estimation, Multi-Cadence ST-JEPA achieves NMSE of 0.1608 versus 0.1403 for Takens-JEPA at τ = 5, and 0.1973 versus 0.1947 at τ = 6. Although Takens-JEPA performs better at τ = 3 and τ = 4 and uses less training compute, these results raise concerns about whether the Takens-inspired endpoint-aligned ranking objective provides sufficiently distinctive, consistent, and generalizable benefits. Moreover, this comparison is only conducted on Active Matter parameter estimation.
-
Appendix D shows that adding more cadence relations does not necessarily improve performance. In particular, the chained relation set {(3, 6), (6, 9)} outperforms the configuration containing all three forward relations {(3, 6), (3, 9), (6, 9)}. I find this an interesting and somewhat counterintuitive observation that is directly related to the core design of the proposed method. However, the paper does not provide a deeper analysis or explanation of this phenomenon, which I consider a noticeable gap.
-
Minor presentation issue: The figures have noticeable presentation issues. Figures 2 and 3 are raster images with limited clarity, and some text and annotations are difficult to read. In Figure 3, some annotations extend beyond the panel boundaries, and the overall layout and visual presentation could be improved.
Questions for authors
-
Regarding Multi-Cadence ST-JEPA, could the authors provide comparisons on the other two datasets and on the endpoint-state reconstruction task? These results would help clarify whether the proposed endpoint-aligned ranking objective provides additional benefits beyond simply exposing the model to multiple sampling cadences.
-
How should we understand the results in Appendix D, where adding more cadence relations does not necessarily improve performance?