- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes R-JEPA, a framework that approaches relational reasoning from a world-model perspective by treating relations as latent state transitions. Given a few support examples, R-JEPA infers an unnamed relation and applies it to a new query to predict the corresponding latent state, which can subsequently be retrieved and reused for multi-step reasoning. To investigate the effectiveness of this formulation, the authors conduct experiments across knowledge graphs and language model representations under various settings, including fact deletion, counterfactual knowledge editing, renamed and invented systems, multi-hop reasoning, and temporal knowledge splits. The paper further analyzes when relational transitions can be performed without learning, based on the consistency of relational directions in the representation space. Finally, it compares JEPA-style latent prediction with classification-based objectives, examining their relative effectiveness under different negative-sampling conditions and candidate space sizes.
Critical strengths
S1. Comprehensive evaluation across diverse settings.
The paper conducts extensive experiments across diverse settings, including fact deletion, counterfactual knowledge editing, multi-hop reasoning, and temporal knowledge splits. These evaluations provide useful insights into the behavior of relational reasoning models under different conditions.
Critical weaknesses
W1. Insufficient motivation and empirical justification for the world-model perspective
The paper motivates R-JEPA by arguing that existing relational reasoning approaches primarily focus on relation identification or candidate scoring, rather than predicting reusable latent states. However, it does not clearly establish what concrete limitations of existing approaches necessitate this reformulation. For instance, few-shot relational learning methods such as MetaR (Chen et al., 2019) infer relations from support examples, while inductive knowledge graph models such as InGram (Lee et al., 2023) and knowledge graph foundation models (Galkin et al., 2024) already investigate generalization to unseen entities, relations, or graphs. The paper does not sufficiently explain which capabilities of these existing approaches are fundamentally inadequate from the proposed world-model perspective. More importantly, the empirical evaluation lacks direct comparisons with these relevant existing approaches. Although the experiments demonstrate knowledge dependence through counterfactual edits, state reuse through multi-hop reasoning, and prediction of unobserved facts, it remains unclear whether these properties are specific to R-JEPA or can also be achieved by existing inductive relational models under the same evaluation protocols. Without such comparisons, the experiments do not sufficiently justify the necessity or distinctiveness of the proposed world-model formulation.
W2. Limited methodological novelty and unclear empirical benefits
The proposed R-JEPA framework exhibits substantial methodological overlap with existing relation prediction and reasoning models. Its core pipeline of inferring relational representations from examples, applying relation-based transformations in latent space, and retrieving entities through embedding similarity is already widely adopted in prior work like logical query reasoning on knowledge graphs. The main methodological distinction appears to be the incorporation of a JEPA-style latent prediction objective, which is itself well established. Furthermore, the empirical results do not demonstrate consistent advantages of the proposed latent prediction approach. Classification matches or outperforms latent prediction in several settings, while parameter-free predicate matching also outperforms learned R-JEPA variants in some experiments. Although consistently achieving the best performance is not strictly necessary, the limited methodological novelty makes it particularly important to demonstrate clear empirical benefits or distinctive capabilities over existing approaches, which remain insufficiently established.
Questions for authors
Q1. Could the authors evaluate recent KG foundation models (e.g., ULTRA) under the same knowledge editing and counterfactual settings to investigate whether they exhibit the limitations highlighted in this paper? How does R-JEPA compare with these models in terms of performance under these settings?