- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper combines formal rules with JEPA and explores the bidirectional relationship between symbolic rules and the latent space. It adds energy-based constraints to JEPA training so that valid rules have low energy in the latent space and invalid rules have high energy, and then uses this energy landscape to generate rules and perform reasoning via Langevin sampling. The paper conducts two experiments, a 3D simulation and a study on the UCI Heart Disease dataset: the simulation compares the energies of valid and invalid rules, while the UCI study evaluates the accuracy of classification by distance to the poles and shows examples of generated rules.
Critical strengths
- The writing is generally fluent.
- The description of the method in Section 3 is fairly clear.
- The paper is fairly candid about its limitations.
Critical weaknesses
-
The motivation is unclear. The paper never explains why JEPA in particular is chosen: the "JEPA" in the experiments is a few MLP layers predicting between features of tabular data, without using any property that distinguishes JEPA from generic embedding learning. The energy-based constraint is essentially the margin loss commonly used in metric learning and could be implemented with any dual-encoder architecture, so the connection between the method and JEPA is weak. In addition, the claim that "logical validity equates to geometric proximity" (p. 2) is too strong.
-
Section 4 proposes generating rules and performing forward and abductive reasoning in the latent space, and lists this as one of the main contributions, but these claims are not sufficiently tested: Table 5 gives only one example per mode, with no quantitative evaluation. The energy in Paradigm 2 is never defined, and the experiments only execute the step , without the sampling and acceptance steps.
-
The experiments are small in scale and do not show significant results. The simulation uses synthetic 3D toy data, and its outcome appears to be a natural consequence of contrastive learning, with limited novelty and significance. In the heart disease experiment, the classic JEPA and RiJEPA both reach 100% accuracy, which does not demonstrate any advantage of RiJEPA. RiJEPA also uses the ground-truth labels directly during training through the anchor loss as I understand, so its pole-based classification cannot be called zero-shot. More importantly, RiJEPA adds both the rule loss and the anchor loss on top of the classic JEPA, and the anchor loss alone could produce the diagnosis-based clusters and pole-based classification. Without more ablations, the effect cannot be attributed to the rules.
Questions for authors
- Could the authors provide more experiments and comparisons with more baselines to further demonstrate the effectiveness of the method?
- For the claims in Section 4, could the authors provide stronger evidence of their actual contribution?
- In the heart disease experiment, which columns are included in the context and the target on the data side, and is the diagnosis label excluded from the input? Could the authors explain why both the classic JEPA and RiJEPA reach 100% accuracy?
4 comments
Engaging with the authors
Dear reviewer,
the authors have posted a reply to your review. Please have a look and interact with the authors as needed.
Thank you, Your AC
Thank you for the substantial revisions and additional experiments. These address my concerns about missing ablations and quantitative evaluation, and I appreciate the clearer scope of the revised claims.
My remaining reservation concerns the strength of the contribution. I acknowledge the demonstrated capabilities, but remain unconvinced that their added value is substantial enough to support acceptance. I therefore maintain my original rating.
Thank you for revisiting the revised manuscript and for confirming that the additional ablations and quantitative evaluations address your earlier concerns. We understand that your remaining reservation is the significance of the contribution, and would like to clarify why we believe RiJEPA adds a meaningful capability beyond conventional predictive representation learning.
1. Rule supervision provides a capability that the supervised anchor alone does not. In matched ablations, the label-anchored rule-pole control without paired-rule training (C1) obtains 0.517 matched-versus-flipped rule AUROC, versus 0.956 for full RiJEPA (S3). The anchor-only JEPA without a rule pathway (C2) attains similar classification accuracy but does not provide rule-energy querying. In the unanchored comparison, adding negative rule pairs increases rule AUROC from 0.735 to 0.966, isolating their effect on sampled rule-pair discrimination.
2. The learned rule pathway supports quantitative reasoning tasks. On previously unmined antecedents, consequent-completion accuracy is 0.836, versus 0.750 for lookup. In class-conditional abduction, 0.567 of generated rule candidates satisfy the held-out empirical-validity criterion, versus 0.120 for frequency-matched random antecedents. The separate context-marginal sampling evaluation attains 0.677 validity after filtering, versus 0.237 for random proposals. These experiments demonstrate complementary completion and proposal capabilities, not a logical-validity certificate or superiority to every discrete search method.
3. These capabilities coexist with comparable predictive performance. Across 15 selected tabular datasets, full RiJEPA reaches 0.868 nearest-pole accuracy, compared with 0.863 for the anchor-only control (Holm-adjusted ) and 0.865 for label-matched supervised contrastive JEPA with a probe. The rule-query benefit is thus distinct from a claim of statistically significant accuracy improvement. The shared interface also operates on five frozen-feature video benchmarks, with held-out rule AUROCs above 0.84 on four; we explicitly report the fifth failure case (0.365).
4. The novelty is the integrated predictive interface, not the margin loss in isolation. To our knowledge, RiJEPA is the first JEPA-style architecture to use one learned predictor for both observation prediction and explicit antecedent–consequent rule queries, thereby supporting symbolic-pole read-out, rule completion, and abductive proposals within one framework. We do not claim the JEPA objective or shared weights are uniquely necessary for every measured tabular gain; the controlled component ablations clarify that scope. The contribution is the unified, quantitatively evaluated data-rule interface rather than a new contrastive margin or replacement for conventional rule mining.
5. Two new figures further clarify the learned representation geometry. We added Fig. 4, comparing classic JEPA and RiJEPA latent representations across all 15 tabular datasets, and Fig. 9, extending this comparison to five video-feature benchmarks. The visualizations illustrate how RiJEPA organizes predicted states around symbolic class poles, with clearer class separation on most datasets. Quantitatively, the mean tabular silhouette improves from 0.101 to 0.563 relative to classic JEPA, while RiJEPA achieves higher test silhouettes on four of five video benchmarks. These figures make the role of the complete rule-informed, label-anchored architecture more tangible and complement the quantitative evidence for its predictive and symbolic capabilities.
We have also updated a new rebuttal PDF version (v3).
We believe this architectural and functional contribution outweighs the remaining limitations of the present evaluation, and respectfully hope the reviewer will reconsider its significance in light of the revised evidence.
Thank you for the constructive review. We have clarified the theory, quantitatively tested both reasoning paradigms, and added matched ablations and broader benchmarks. The central results now appear in Tables 3–5 and Figure 4, with details in Appendices G–K.
1. Why JEPA, and what is novel? JEPA supplies masked-context latent prediction and an EMA target encoder. RiJEPA connects this data-prediction pathway to symbolic antecedent–consequent pairs using modality-specific encoders and a shared predictor. EBC shapes their energies through positive and sampled negative pairs; a separate supervised anchor aligns observations with class poles. We agree the margin loss is not unique to JEPA. In a first-fold ablation over 15 datasets, removing the JEPA data loss changes pole accuracy +0.006, silhouette +0.012, and matched-versus-flipped rule AUROC −0.003; replacing the shared predictor with separate predictors changes these by −0.003, −0.006, −0.002 (Appendix H). Thus we do not claim JEPA is necessary for these tabular outcomes. The contribution is an integrated predictive data–rule query interface, rather than a new contrastive-loss identity. We have also replaced “logical validity equates to geometric proximity”: Proposition 1 ensures separation only for constrained rule pairs at zero loss, not validity of arbitrary unseen low-energy rules (Sec. 3; Appendix I).
2. Quantitative evidence for Section 4. Rule completion on previously unmined antecedents achieves 0.836 accuracy versus 0.750 for lookup; class-1 Langevin abduction yields 0.567 held-out-valid candidates versus 0.120 for frequency-matched random antecedents (Appendix J). For Paradigm 2, Sec. 4 now defines Ectx(zc)=−logp^ctx(zc) using a Gaussian KDE of training-rule antecedent embeddings. The implemented procedure explores this energy by Langevin updates, predicts with g(zc), decodes items/poles, and applies an optional training-only confidence filter. Held-out rule validity is 0.647 before filtering and 0.677 after, versus 0.246 for joint Langevin and 0.237 for random proposals (Table 5; Fig. 4(b)). 71.7% of accepted pairs are absent from mined training rules, but novelty does not guarantee validity. Acceptance is a Metropolis-style heuristic, not exact MH without proposal-density corrections; plausible context proposals explain most of the improvement.
3. Does EBC contribute beyond the supervised anchor? Across 15 exploratorily selected tabular datasets (2×5 stratified folds), matched JEPA + supervised poles without rules reaches 0.863 mean accuracy, versus 0.868 for full RiJEPA (Holm-adjusted p=0.767). Supervised contrastive JEPA + probe reaches 0.865 (adjusted p=1.0). Thus the anchor explains most classification gain; EBC's more distinctive result is rule discrimination (Table 3; Appendix H). In the unanchored staged comparison, adding negatives raises matched-versus-flipped rule-energy AUROC 0.735→0.966, and completion 0.704→0.839 (Fig. 4(a)); within the fully anchored model, the negative-margin AUROC contrast is smaller (0.941→0.956). For arbitrary held-out rule candidates, energy ranks empirical validity at AUROC 0.845, below training-row confidence 0.924 (Appendix I). These scores are not soundness or causal-explanation certificates.
4. Broader comparisons and statistical limits. We evaluate 15 tabular datasets with ten test folds and five fixed-split video benchmarks using frozen ResNet-18 features and five seeds (Table 4). RiJEPA pole-readout gains over JEPA probes are +13.8, +16.8, and +10.9 percentage points on KTH, UT-Interaction, and MNNIT; HMDB51 and RLVS show negligible changes. The broader 115-dataset exploratory screen finds higher accuracy on 47/115 datasets and higher balanced accuracy on 81/115 (Appendix G). We acknowledge dataset screening, small video test sets, seed-only variability, and the absence of end-to-end video training.
5. Clarification of the previous 100% result. The original comparison was invalid because the diagnosis label inadvertently remained in two unmasked one-hot input columns. We have removed that result and its related figures, as they do not support the revised claims. In the retained experiments, class labels are excluded from observation inputs and used only for explicitly supervised training-rule consequents and the pole anchor. The pole read-out is therefore classifier-free but label-informed, not zero-shot (Secs. 3, 5; Appendix G).
We thank the reviewer for motivating these theoretical corrections, controlled comparisons, and quantitative reasoning experiments.