- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes EquiJEPA, a JEPA-based world model that encourages consistent latent displacements for the same action across difference states. The authors argue that the resulting transition concentration facilitates action prototype reuse, composition, and the detection of state dependent interactions.
Critical strengths
The paper presents a simple and intuitive approach to encouraging action equivariance in latent representations. The resulting representations exhibit interesting properties, including the composition and reuse of action prototypes, which could be useful in certain settings.
Critical weaknesses
- My primary concern is that the action equivariance may impose a rather restrictive assumption that does not generally hold in realistic environments. Specifically, the addition of latent displacements is commutative, whereas the transitions by the action sequences in many robotic environments are not. For example, consider two actions for a 2D dot moving toy environment: (1) rotating 90 degrees to the left and (2) moving forward one step. Performing (1) after (2) and (2) after (1) leads to different xy positions, while the action equivariance requires the latent representation of the reaching states to be identical; this can creates a fundamental conflict with the need to distinguish the resulting states. I understand that the proposed method encourages equivariance through a soft constraint rather than enforcing it exactly. Nevertheless, this example suggests a potential tradeoff between the proposed equivariance and the ability to represent general MDP. I believe the paper would benefit from a more thorough discussion of this limitation and the conditions under which the proposed assumption is reasonable.
- While the authors demonstrate potential applications such as action prototype reuse and the detection of state dependent effects, it is not entirely clear why these properties are particularly important for JEPA based world modeling. In addition, direct action composition is primarily evaluated in a simplified two dot environment where action effects are inherently additive. Although prototype reuse is also evaluated in Push-T, it would be helpful to further investigate whether the compositional properties extend to more realistic environments with noncommutative dynamics.
- The proposed method builds upon an existing inverse-dynamics JEPA [1] by introducing a relatively simple equivariance loss and an effect prediction head. While simplicity is certainly a desirable property, I am not fully convinced that the technical novelty and demonstrated practical benefits are sufficiently substantial for the top tier conference, particularly given the restrictive nature of the proposed inductive bias and the inconsistent improvements in downstream planning.
[1] Petr Ivashkov et al., Sensorimotor World Models: Perception for Action via Inverse Dynamics, arxiv, 2026.
Questions for authors
- Could the authors further clarify the fundamental motivation for encouraging action equivariance in world models, particularly when this property may conflict with the underlying environment dynamics? Furthermore, while it is understandable that action decodability does not necessarily imply transition concentration, the importance of concentration itself for world modeling remains unclear to me. I believe a more explicit discussion of why these properties are desirable would strengthen the paper.
- Have the authors considered evaluating the method on other environments involving multiple interacting objects and more complex action dynamics, e.g. OGBench Scene? Such experiments could help clarify the applicability of the proposed approach beyond environments with relatively simple action structures.
- The notation for expectations appears somewhat inconsistent, with square brackets used in some places but omitted in others. It would be helpful to make the notation consistent. Additionally, the first paragraph of Section 3.3 could provide a more intuitive introduction to controlled replay and held out action fit , as these metrics are introduced rather abruptly.
- I wonder whether Figure 1 is the most informative result to highlight immediately after the abstract. Since EquiJEPA explicitly optimizes for transition concentration, the improvements in Figure 1 and Table 1 are somewhat expected and do not necessarily demonstrate practical utility. I believe a figure that jointly illustrates improved transition concentration and the preservation of state information, as evaluated in Tables 1 and 2, could provide a more comprehensive overview of the main findings.