- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
WeatherJEPA learns a shared atmospheric representation from observations and reanalysis data. At deployment, it forecasts from observations without reanalysis inputs. Training objectives align representations, preserve weather information, and support prediction over time.
The authors evaluate current-state decoding, 10-day forecasts, and training-objective ablations. Against controlled learned baselines, day-10 errors fall by 4.4-12.7% across six selected targets. Results also show that better current-state decoding does not always imply better forecasts.
Critical strengths
-
Weather JEPA uses reanalysis to guide representation learning while allowing forecasts to start from observations alone. Its improvements extend across station, radiosonde, and satellite targets, and across forecast lead times. This breadth strengthens the empirical case beyond a single aggregate score or selected target.
-
Current-state decoding rankings do not consistently match forecast rankings, and rankings change with forecast duration. This shows why decoding tests alone are insufficient. I believe this is a lesson relevant to broader representation learning research.
Critical weaknesses
The authors use controlled adaptations of three competing methods, but provide limited details about their training. Appendix A.2 states that the baselines follow the original architectural and training designs and use the same observation data and targets. However, their model sizes and training budgets are not reported. The reanalysis records used by each baseline in this study are also unclear. Appendix A.4 describes sequential adaptation across forecast leads for WeatherJEPA, but does not state whether the baselines use this procedure.
These choices can affect forecast accuracy. Without these details, I cannot assess how much of the reported improvement reflects the proposed method rather than differences in training. Since these comparisons provide the main evidence for gains over competing learned methods, this limits my confidence in those gains.
Questions for authors
-
Appendix A.2 states that the baselines follow the original architectural and training designs. What changes were made for this study? Please give each baseline’s model size, training budget, and checkpoint selection procedure.
-
Appendix A.1 states that the longer ERA5 archive ends in 2017. What is its starting year? Which reanalysis records were used to train each baseline in this study?
-
Appendix A.4 describes sequential adaptation across forecast leads and separate observation decoders for WeatherJEPA. Were these procedures also used for the baselines? If not, what forecasting and readout training did each baseline use?
-
Section 5.1 identifies the WeatherJEPA state as the observation-only deployment state. Which pre-forecast state was tested for each baseline? Please specify the architecture and training settings of the lightweight readouts used for the matched comparison.