- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper addresses the problem of using predictive JEPA architectures for planning. Like others, the authors note that a lower prediction error does not necessarily correlate with better planning capabilities. To remedy this problem, they propose using a residual prediction scheme (predict the difference Delta_{z_t} between the next step z_{t+1} and the current one z_t) instead of the usual one (predict the next step), plus a regularizer encouraging Delta_{z_t} (in both its ground-truth and predicted forms) to predict the command that has been used to transition from z_t to z_{t+1}. This is a reasonable approach, and it improves planning performance on several benchmarks compared to other comparable methods, but the only real novelty appears to be the residual prediction, which is not well justified and dot not improve performance on its own.
Critical strengths
The method is reasonable and the combination of the residual prediction with the control-grounding regularizer gives good results.
Critical weaknesses
The main weakness is the lack of novelty of the paper. As far as I understand the "control-grounding" regularizer is a simple variant of the inverse dynamics regularizer used in Sobal et al. and ZHang et al. for example. The only true novelty I could find was in using a residual prediction of the next step, but this by itself does not improve planning performance, as noted by the authors themselves.
Questions for authors
Try to better justify the residual prediction.
The prediction-planning gap is expected, and I would like the authors to elaborate on the purpose of the corresponding section and of the counterfactual consequence discrimination section and the conclusions to be drawn from it since they were not obvious to me.