- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents a decoder predicted skip alignment method for improving surrogate models for PDE forecasting tasks in advective systems. The proposed method has each decoder level predict a learned displacement field that resamples the corresponding encoder skip to align with known movement that happens as time marches forward in the advective PDE system. The main contribution is the development of the skip connection alignment methodology for multiscale encoder decoder architectures along with the extension of the methodology to be used in multi-step and multi-state scenarios, which allow for more accurate predictions and fewer model invocations for long horizon rollouts. The method is shown to work in cases where target data is used as well as for cases where a physics loss is use instead when the multi-time step scenarios do not align with target data. This methodology is also used to show that under physics supervision the model can be trained from coarse inputs to still forecast accurately from resolution states.
The authors present various experiments evaluating the alignment methodology on various advective PDE flows showing improved accuracy over various scenarios. These experiments inlcude baseline comparison, ablation studies, use with different multiscale convolutional encoder decoder architectures, testing of accuracy in multi-step and multi-state scenarios, use of physics loss for data free training, and transfer from coarse inputs to higher resolution states.
One critique is there a multitude of experiments testing the three different contributions. The main text relies heavily on the appendix for presenting results making it hard for the reader to follow and understand the significance of the different results.
Critical strengths
The consistent benefit of the alignment across a broad range of settings.
Critical weaknesses
The presentation of the results is difficult to follow. The main text is not self-contained relying heavily on the appendix.
Questions for authors
What is the practical utility of the method as a simulation surrogate? How would it be used in realistic scenarios?
We thank the reviewers for their feedback and comments, which help us improve the paper. The reviewer raised concerns regarding the novelty, value, coherence, soundness, and justification of the paper’s contributions. Before addressing these concerns individually, we would like to clarify the broader perspective and practical motivation behind this work.
Our research spans machine learning, numerical methods, turbulence modeling, and physics. We therefore approach surrogate modeling not only as a problem of neural-network design, but also from the practical perspective of modeling physical systems when numerical or experimental data may be limited, corrupted, incomplete, or available only at low spatial resolution. Our goal was to develop simple and computationally efficient modifications to existing approaches that enable accurate surrogate models to be trained and used under these challenging data conditions.
Although our methods build on established ideas in surrogate modeling, learned spatial warping, and equation-supervised training, we respectfully disagree that they merely combine previously explored techniques. To the best of our knowledge, the specific methods proposed in this work are novel. Despite their relative simplicity, they produce substantial improvements in predictive accuracy for convection-dominated systems. Importantly, these improvements are not limited to a single selected model size or prediction interval. Our experiments demonstrate systematic improvements in the accuracy-computational-cost trade-off across multiple model sizes and prediction intervals, supported by controlled ablations, comparisons with closely related architectures, and physical analyses of the learned representations.
The three contributions are also important as a unified methodology. They address complementary obstacles to training accurate and efficient surrogate models from limited data, and they reinforce one another. Skip alignment improves hierarchical prediction across nonzero temporal intervals. This enables more accurate intermediate-state prediction and fractional-step equation supervision without future-state targets. Persistent-state training then uses this temporally refined, equation-supervised framework to develop physically consistent full-resolution training conditions when only severely reduced spatial observations are available. Together, these contributions address the difficult and practically important problem of learning accurate, computationally efficient, full-resolution dynamics from progressively less complete training data.
In our subsequent responses, we address the specific points raised by the reviewers.