- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces NeuralPDE, a latent dynamics model where the hidden state is represented as a continuous latent function instead of the standard latent vector. The latent function evolves according to an advection-diffusion-reaction PDE, whose coefficients are learned jointly with an encoder-decoder architecture. The PDE is implemented through a Fourier spectral discretization and trained end-to-end. The paper includes theoretical properties of the proposed dynamics and experiments on multiple forecasting benchmarks. The main claim is that latent PDE evolution provides a richer inductive bias than conventional latent ODE models and leads to better forecasting accuracy, particularly for long-term prediction tasks.
Critical strengths
++ The general idea of evolving a latent function rather than a latent vector is intuitively appealing. The ADR decomposition provides a structured inductive bias where advection, diffusion, and reaction have interpretable roles. The technical analysis of the ADR is sound and clearly presented.
++ Strong reproducibility effort: all the hyperparameters, and experimental settings are well documented. The exeperimental protocol is sound and thorough. The code is released anonymously (although I didn’t check the code).
Critical weaknesses
My main concern is about the novelty of the paper. The related work section and positioning is clearly insufficient. There is a broad recent literature on learning PDEs in latent spaces that is not covered:
-
Latent Evolution of PDEs (Wu et al., NeurIPS 2022)
-
Latent Neural PDE Solver (Li et al, 2025)
-
Latent Neural Operator (LNO) (NeurIPS 2024)
-
AROMA (NeurIPS 2024)
After Fourier truncation, the proposed ADR evolution becomes a finite-dimensional ODE solved by a NeuralODE, making the novelty with existing work not clear. It seems to be just another particular parametrization, although elegant, of latent continuous dynamics.
Lack of recent baselines in the experiments: the strongest baseline is a matched Neural ODE. The papers lacks comparison with recent neural solvers (LE-PDE, etc) that are missing in the related work, or at least the authors should justify why these recent baselines are not taken into account.
As acknowledged by the authors, the experimental results are mixed across datasets and configurations. While honest, the paper does not bring insight to the contribution of the proposed approach to forecasting performances, and in what cases it brings a real benefit. The theoretical analysis of the ADR operator, while interessant, is disconnected from the analysis of the forecasting performances.
Questions for authors
- Could you provide an ablation over the number of Fourier modes?
Dear Reviewer SZiw,
As the rebuttal discussion period nears its end, we would like to gently follow up on our responses and the additional experiments presented in the revised manuscript. We remain happy to address any remaining concerns or provide further clarification. If you feel that our responses and additional evidence have satisfactorily addressed your concerns, we would be grateful if you would consider revisiting your rating. Thank you again for your time, thoughtful feedback, and consideration.