- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ALTALS, a method that consists of a regularization loss for anti-collapsing and a relational geometry calibration loss. The authors conducted experiments on PushT, TwoRoom, and OGBench-Cube with a goal offset of 50.
A few concerns about this paper:
- Renaming an existing method, SWD, to WEMReg should not be presented as a proposed method. Also, you should compare with [1] and [2] to show the real advantage. Due to the short timeline, these two papers have not been published yet, but neither have LeJEPA or LeWM, so I think it is fair to compare against these two methods.
- It is good to test on OOD data, but the OOD dataset selection should not be based on KNN. The stable-world-model repo provides an easy way to change the color, add noise, etc to create the true OOD test set. To make everything easier, you can just replay the original action. This comparison should be more convincing.
- Considering the scale of the experiments is relatively small, the authors should also add Reacher to provide a complete comparison among these methods.
[1] VISReg: Variance-Invariance-Sketching Regularization for JEPA training
[2] Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
Critical strengths
I don't see an obvious strength of this paper. Although the performance of ATLAS is better than LeWM, there is a big misalignment between the motivation of the proposed method and the actual experimental settings. This makes the argument in the paper not convincing.
Critical weaknesses
- Renaming SWD to WEMReg should not be considered a proposed method.
- OOD should not be picked from the training set by KNN. Considering 50 steps as the offset, the result could be affected by the horizon rather than by OOD.
- VISReg and LpJEPA should be added to the related work. If possible, add the corresponding comparison.
- There are a lot of other works to compare in the ID setting. Please add them so the judgment is not biased.
Questions for authors
Why is the Reacher dataset not involved in this paper? Since this paper is mainly comparing with LeWorldModel, the comparison should be complete.
W1: Renaming SWD to WEMReg should not be considered a proposed method.
Thank you for these pointers. WEMReg is not presented as a novel optimal transport distance. Its connection to sliced Wasserstein matching is explicitly acknowledged through citations to the original literature in both the introduction and related work. Importantly, using an established statistical discrepancy does not preclude a methodological contribution in representation regularization. SIGReg itself builds on established characteristic-function-based Gaussianity testing. The relevant question is therefore not whether the underlying statistical tool is new, but what role its formulation and analysis play in the proposed learning objective. Our contribution is to identify a limitation of finite-frequency matching, theoretically characterize this distinction in Theorem 1, and investigate projected Wasserstein calibration in conjunction with an independently motivated relational-preservation constraint. We will also incorporate VISReg and Rectified LpJEPA into the related-work discussion to clarify the positioning of ATLAS among existing JEPA regularization methods.
W2: OOD should not be picked from the training set by KNN. Considering 50 steps as the offset, the result could be affected by the horizon rather than by OOD.
We thank the reviewer for this suggestion. Our use of the term “OOD” follows the nearest-neighbor convention[1], where OOD refers to states lying in low density regions of the training distribution. Under this definition, the standard way to identify such states is by their distance to the training support, which is what the KNN split measures. ATLAS is designed to preserve the representational structure that separates states near versus far from the training support, while a perturbation test such as changing color or adding noise probes robustness to appearance or covariate shift, which is a valuable but different property. We will state our definition of OOD more explicitly in the revision to avoid this ambiguity.
[1] Yiyou Sun, Yifei Ming, Xiaojin Zhu, and Yixuan Li. Out-of-distribution detection with deep nearest neighbors. In International Conference on Machine Learning (ICML), 2022.
W3: The authors should also add Reacher to provide a complete comparison among these methods.
Thank you for raising this. Now we have added Reacher into our experiments and here are the success rates: