- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors use PCA on the training data to find the main directions in which the ground truth states vary. They then split each predicted state into two parts: one inside the PCA subspace and one outside of it. If the part outside of the subspace is too large, they shrink it. The idea behind their method is to reduce errors that build up during long rollouts. However, the authors also show that this correction can make predictions much worse if the removed part contains important dynamics. They test the method on several PDE datasets and show when the correction is useful, does nothing, or hurts the prediction.
Critical strengths
-
The problem of misaligned autoregressive rollouts is a difficult and important problem. I appreciate the authors investing time, and effort into this topic.
-
The biggest strength for me is that the authors also show where their method fails. They do not only report improvements, but also cases where the correction makes the predictions much worse. I think this is useful, especially since it shows that moving predictions closer to the training data is not always a good idea.
-
I also appreciate the ablations. The authors test different correction strengths, different PCA subspaces, and different types of errors. These experiments help explain why the correction works in some cases and fails in others.
Critical weaknesses
-
The paper is very difficult to read/follow The ideas is simple, but the paper makes it hard to follow. It appears like large parts have been written by AI, and there was no human-review afterwards. As a reader, I repeatedly had to look ahead for explanations, guess what certain symbols mean (as some are explained after their introduction or not at all), or search in the appendix to find out what has been evaluated. Some of these issues can be understood from context, but a reader should not have to guess what the authors mean. I think the paper needs a major rewrite. This is not just a matter of fixing a few sentences or adding some definitions. The method and experiments need to be explained in a much clearer order.
-
The comparison with existing correction methods In the paper, the authors did a good job in their ablation of the method itself, but I am not entirely convinced that the paper properly establishes what is new compared to previous work. There are already several methods that correct or stabilize predictions during PDE rollouts. Some appear closely related to the presented method. For example:
- Li et al. (2022), Learning Dissipative Dynamics in Chaotic Systems, already worked on how to stabilize learned dynamics by applying a correction when predictions leave a certain region.
- Oommen et al. (2024), Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling, used diffusion models for corrections of neural operators.
- McGreivy and Hakim (2023), Invariant Preservation in Machine Learned PDE Solvers via Error Correction, correct neural PDE predictions using physical constraints.
- Wells et al. (2015), An Evolve-Then-Filter Regularized Reduced Order Model, showed filtering numerical solutions using POD-based methods. This seems particularly relevant since the proposed method also uses a PCA/POD subspace. I wonder where in this the proposed method fits it, and more important, maybe a direct comparison to similar methods.
Questions for authors
- What is the main novelty compared to the existing stabilization/corrections methods? In particular, how does the proposed method differ from dissipative stabilization methods such as Li et al. (2022) and POD-based filtering methods such as Wells et al. (2015)?
- Why are there no direct comparisons against simpler correction methods? For example, how does the proposed method compare against standard PCA/POD projection or a simple dissipative correction when applied?
- Why do 14 of the 15 APEBench benchmark rows not use the proposed method?