- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The proposed paper studies some issues of current neural surrogates regarding high frequency modeling and long range divergence. These issues have been well identified by the community and remain a strong limitation of the majority of the current models. ReAl proposes to solve this issue with a refiner trained in 2 steps, each of them addressing one these challenges. First a flow matching based training on the residual for a better modeling of high frequencies, and second a reinforcement learning training that aims at stabilizing long rollouts. The paper comes with some experiments to illustrate the claim and some appendices providing details on the metrics and baselines as well as some visualizations.
Critical strengths
- I found the paper clearly written and easy to follow. Each component is introduced with the corresponding level of details for me. A minor modification for me would be to add in the appendices some details about on the RL side (algorithm, pseudo-code for instance)
- The problem studied is well identified in the literature and an additional refiner could be pluged onto already existing models without architectural modifications
- The datasets studied are challenging and very recently proposed to the community
Critical weaknesses
-
I think the experimental part could be improved to make the paper more convincing, especially regarding baseline comparison. In my opinion, a strong part of the literature is missing in the experiments as the method is only compared wrt to models without the additional refiner. I fell like it is a bit unfair to compare these methods as they have not been designed for this problem, when huge literature on the two subjects exists. Some papers are mentioned in the related work section. I think a strong experiment is missing here as we do not have any comparison with other methods addressing the same problems. Why not comparing to PDE-Refiner or Flow Refiner that you mentioned ? Additionally, I believe more recent baselines could be used. Why considering Transolver and not Transolver ++ [1] or ECHO [2] recently proposed ? While I acknowledge that very recent models can be difficult to spot and reproduce, a two year gap is quite long in the literature. One could think about Thermalizer [3], TNS [4], Dyslim [5] as more recent relevant work.
-
I also think that the related work section could be improved. In order to clearly position the paper, maybe that a sub-section on long-range stabilization method and another on high-frequency modeling would help position the paper wrt to existing method that actually target the same problem.
-The note at the bottom of page 3 is not demonstrated nor illustrated in the paper. A small ablation to study the impact on the prediction or history window would illustrate this point.
- No limitation section is provided.
[1] Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometries. Huakun Luo, Haixu Wu, Hang Zhou, Lanxiang Xing, Yichen Di, Jianmin Wang, Mingsheng Long. 2025
[2] Efficient Generative Transformer Operators For Million-Point PDEs. Armand Kassaï Koupaï, Lise Le Boudec, Patrick Gallinari. 2025.
[3] Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaos. Chris Pedersen, Laure Zanna, Joan Bruna, 2025.
[4] Towards Infinitely Long Neural Simulations: Self-Refining Neural Surrogate Models for Dynamical Systems. Qi Liu, Laure Zanna, Joan Bruna, 2026.
[5] DySLIM: Dynamics Stable Learning by Invariant Measure for Chaotic Systems. Yair Schiff, Zhong Yi Wan, Jeffrey B. Parker, Stephan Hoyer, Volodymyr Kuleshov, Fei Sha, Leonardo Zepeda-Núñez. 2024
Questions for authors
- Have you studied what kind of errors are corrected by the refiner ? Is it numerical noise ? measurement errors ? or is it actual dynamical high frequencies ? The strong decrease in energy on figure 1a makes me wondering about the nature of these frequencies in the dynamics.
- Can you provide the training cost and inference time & memory consumption ? As the method incurs an additional 2 staged training, this metrics is very important to evaluate its applicability. Also, how does it increase inference time ?
- Are all baselines on the same experimental setting ? (10 input frames to predict the 10 following ?) Can you comment on the claim of "Long-range" ? In the experiments, are only 5 calls to the model required to predict the 50 time steps ? In this case and with the very little number of calls to the model, can we really talk about auto-regressive error accumulation ?
- Isn't the trajectory-level reward used in the alignement phase training ? ( (lines 258-269 and equation 15)
- With the two staged training, have you observed some forgetting in the refiner ? For instance are the high frequencies better reconstructed before the alignement phase ?
- Could you precise if the alignement stage is trained only on the last rollout step (lines 260 & 310) or on every auto regressive step ?
- Regarding W1, can you compare to dedicated methods for long range stabilization and high frequency reconstruction ? While Table 1 is convincing regarding the broad applicability of the method, I believe that it is more important to show that it is competitive wrt other existing method. Why one should use ReAl wrt any other designed model or correction method for these challenges ?
- Have you evaluated the method on an OOD setting ? What I mean here would be to train the method on a given horizon, and evaluate the behavior of the refiner beyond this training horizon.