- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies whether predicting weather in a learned latent space can reduce error accumulation in forecasts. The proposed model, JEPA-WX, encodes weather fields, predicts how the encoded state changes, and decodes it back into weather fields. It combines a JEPA prediction objective with reconstruction and regularization losses, and trains on multiple forecast steps.
The authors use 39 years of ERA5 data at 5.6° resolution and compare forecasts up to 14 days with persistence and a U-Net. They report smaller errors than persistence and slower error growth than U-Net, although U-Net performs better at short lead times. Tests that remove individual training components suggest that reconstruction and regularization are needed, while multi-step training improves forecast accuracy.
Critical strengths
This paper explores a very useful question: can prediction in a learned latent space improve weather forecasts at longer lead times? The reported results show slower error growth than U-Net and improvements on some variables at longer leads. This makes the approach worth further study.
Critical weaknesses
-
The comparisons are too limited. The paper evaluates only persistence and a U-Net, with no alternative latent dynamics model or controlled comparison using the same architecture. The training also differs substantially. JEPA-WX uses multi-step training, 80 training epochs, and another 20 epochs for decoder tuning. U-Net uses single-step training for 30 epochs. Table A.5 reports 16.5 GPU-hours for JEPA-WX training versus 3 for U-Net. These differences leave a basic question unanswered: does JEPA reduce error growth, or does the model benefit from its architecture and training? Resolving this requires substantial new experiments.
-
The evaluation uses test-set targets to fit the calibration factor applied to the main RMSE results (§4.4). This violates the basic requirement that test data remain separate from fitting the prediction procedure, including its post-processing. The appendix does not resolve this concern. Table A.1 reports exactly the same RMSE values as the calibrated results in Table 1, although the text says they are 5–20% higher. Thus, neither the effect of calibration nor the reported uncalibrated results can be verified from the paper. The authors need to fit calibration on validation data and report consistent results on an untouched test set.
Questions for authors
I have no further clarification questions. For a revised submission, I suggest adding non-JEPA latent dynamics baselines and doing comparable multi-step training. Calibration should be fitted on validation data, with consistent calibrated and uncalibrated results reported on the test set.