- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
(There may be inadvertent errors in any areas where AI is not used, such as in writing or reading academic papers.)
This paper is the first to attempt a JEPA framework in the video prediction area.
Basically, this framework consists of an encoder-predictor-decoder architecture. The encoder encodes observation data, and then the predictor predicts future feature states, and the decoder decodes them into observation-domain data.
Because the observation domain has a lot of risks (e.g., noise structure), attempting a JEPA framework is reasonable.
Critical strengths
In this paper competitively provide detailed evaluation protocols
Also, that paper evaluated a lot of dataset like Shanghai Radar, MeteoNet.
Critical weaknesses
The two main weaknesses are evaluation and novelty.
First, regarding evaluation, SEVIR is a standard dataset for weather prediction, but the authors chose two less commonly used datasets, making comparisons with other methods difficult.
For example, SEVIR is essential for comparisons with models such as RainODE [1], CasCast [2], and PreDiff [3]. Even if this paper does not directly compare against these models, results on SEVIR are necessary for readers to make their own comparisons.
Also, on the TrafficBJ traffic prediction dataset, the reported baseline results are worse than those in the official OpenSTL [4] repository. The authors might argue that they could not reproduce those results in their own experiments. However, OpenSTL is well known for its reproducibility and is widely used by many researchers, including myself. Therefore, the authors should properly reproduce baselines such as SimVP and TAU using the OpenSTL framework.
Regarding novelty, although this method applies the JEPA framework to video prediction, SimVP already follows the same concept: an encoder compresses observations into features, a predictor transforms these features into future states, and a decoder reconstructs the observations. Therefore, the method feels like it mainly adds stabilization techniques such as EMA and makes training more complicated.
[1] Seong, Yeeun, et al. "RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs." European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2026.
[2] Gong, Junchao, et al. "Cascast: Skillful high-resolution precipitation nowcasting via cascaded modelling." arXiv preprint arXiv:2402.04290 (2024).
[3] Gao, Zhihan, et al. "Prediff: Precipitation nowcasting with latent diffusion models." Advances in Neural Information Processing Systems 36 (2023): 78621-78656.
Questions for authors
N/A