- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The authors propose three techniques to enforce causality in PINNs training: a power-law causal weighting scheme (in contrast with the usual exponencial scheme), a learnable exponent, and a novel architecture combining Mamba state space models and standard MLPs.
These strategies are evaluated on three benchmark problems: an Allen-Cahn equation, a chaotic Lorenz system and a 2D incompressible Navier-Stokes flow.
Critical strengths
The authors present a good reasoning for adopting a power-law weighting scheme.
Critical weaknesses
(1) Although there is a good mathematical explanation about the power-law weighting scheme, there is no much scientific insight for the two other techniques. To some extent, it looks more like a technical report.
(2) The experimental evaluation is limited. There is no explicit explanation on what the baselines are (I assume they are taken from Wang et al., 2024b). There is no mention to training time. There is also no comparison between number of parameters. The comparison per window is useful to get insight on how the proposed strategies work (and what are their limitations), but they seem to be presented as quantitative comparison metrics.
(3) The benchmark problems are not described in the paper. It is not explicitly stated that they are precisely the same as in Wang et al., 2024b, although it seems to be the case. This is particularly problematic because the title mentions "long-horizon dynamical systems", and there is no mention to the size of the temporal domains of the problems.
Questions for authors
I'm not sure I understand Figure 6. The CausalPINNMamba prediction seems to be quite wrong, qualitatively. Is that correct?