- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Innovation SIGReg, which applies Gaussian regularization to persistence-adjusted transition residuals instead of marginal embeddings in JEPA world models. It combines estimated coordinatewise temporal persistence with a raw-embedding anchor to prevent collapse and investigates different gradient-handling strategies for estimated statistics. Experiments on Reacher and Two-Room evaluate representation quality and downstream planning performance.
Critical strengths
The paper distinguishes statistics updates from gradient propagation and reveals substantially different effects across Reacher and Two-Room. This analysis provides useful insights into optimization behavior beyond simply introducing another regularization objective.
Critical weaknesses
- The best batch-detached variant achieves 97.5% planning success on Two-Room but is not evaluated on the official Two-Room dataset or PushT. Meanwhile, the earlier unguarded variant underperforms marginal SIGReg on both settings. This raises concerns about whether the reported planning improvements generalize beyond the selected experimental setting.
- Reacher's normalization and differencing baselines are not independently tuned, and Two-Room lacks a temporal-differencing baseline with matched statistics detachment. Consequently, it remains unclear whether the improvements arise from the proposed persistence-adjusted residual or simpler stabilization and optimization choices.
Questions for authors
- Since the strongest batch-detached configuration is only evaluated on the regenerated Two-Room dataset, can you provide its performance on the official Two-Room dataset and PushT to demonstrate whether the observed improvements generalize?
- Given that the adaptive guard shows no statistically significant advantage over simpler fixed or scheduled anchors, nor over the marginal Sub-JEPA baseline, what evidence demonstrates that regularizing transition residuals or using participation ratio triggering provides a distinct benefit for planning beyond simply tuning the effective marginal regularization weight?