- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Align Latent Rollout (ALR) is introduced in this paper, which imposes training-time regularization to AR-based NeuralPDEs. For a deterministic PDE, the paper observes this cross-origin consistency phenomenon, where rollouts with different temporal origins would eventually reach identical states. This motivates two loss terms that are derived from the induced latent convolution map. The losses, when added to the standard one-step training objective function, are able to bring consistent relative error reductions.
Critical strengths
-
This is a light-weight training time regularizer that costs nothing extra during inference. It is agnostic to the underlying model backbone. The comparison is clean and transparent with a uniform gain across several public benchmarks over .
-
The paper bases itself on the "cross-origin consistency" principle, the semigroup property of deterministic flows. This makes the approach physically well grounded.
Critical weaknesses
-
Current comparisons are only limited to models with naive unrolling, while other strong baselines, like PDE-Refiner, scheduled sampling, SGNO, and DySlim, are discussed as related work but never actually compared against the proposed method.
-
The benchmarks are narrow in scope, everything is 2D single channel on regular grids, and no 3D or irregular meshes are included at all. This is concerning because ALR has been reported to perform well on every single dataset, and we want to understand where the boundaries of its limitations are, especially for hard systems with high Reynolds numbers, strongly stiff systems, or systems with bifurcations.
Questions for authors
-
Why are baselines like PDE-Refiner, scheduled sampling, SGNO, and DySlim not reported? Can the authors provide a comparison of those baselines with the proposed approach?
-
What is the number of seeds used for reporting the results in Table 1? This is needed to determine the statistical significance of the std bar reported in the table.
-
Can the authors report ALR's gains on harder systems and datasets, and maybe include a failure mode analysis? To name a few, systems with high Reynolds numbers, strongly stiff systems, or systems with bifurcations.
2 comments
We sincerely thank you for your timely reply and positive assessment of our work. Your thoughtful suggestions have helped us strengthen our experiments and improve the paper. We greatly appreciate your time and support.
Thank you for your rebuttal, which has addressed most of my concerns. I am happy to raise my score.