- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes the "FLux balance for INitial-data Transport" (FLINT) concept to address the failure of global space-time PINNs in preserving high-frequency initial data during transport. Key contributions are a weighting mechanism that suppresses the strong-form PDE residual specifically at compressive shocks while maintaining it elsewhere, and evaluation/validation showing superior performance in wave amplitude, phase, and global conservation compared to other neural network approaches.
Critical strengths
- The use of anchored control volumes provides a direct non-local link between initial conditions and later predictions, effectively overcoming the "smoothing" effect often seen in PINNs.
- The introduction of the benchmark and more problems provide a good test of transport and wave-capturing capabilities.
- The inclusion of proposition (B.1) combined with the linear-advection experiments provide a clear theoretical explanation for why small PDE residuals do not necessarily guarantee accurate wave recovery.
Critical weaknesses
- The contribution seems to be incremental; a loss term designed for very specific shock scenarios. The experiments do not help alleviate this assessment, because they are done on very simple toy problems with no comparison to the state of the art (traditional solvers for these csaes). Claims about potential higher dimensionality are not backed up.
- No theoretical analysis or substantial contribution.
- The authors acknowledge that the computational expense remains high compared to traditional finite-volume solvers, although they argue for the potential of PINNs in higher dimensions. It is not clear which problems they mean in particular, as high-dimensional PDEs with shocks are not particularly common.
- It is not clear how much the presented approach depends on the network architecture and how much the results are attributable to the choice of loss funciton (the new contribution). Capturing shocks with a continuous (even smooth) network is not ideal, and integrating a discontinuity as an output of the network may help more - akin to traditional Riemann solvers.
- Some hyperparameters are hand-tuned per-problem, which makes it hard to assess the immediate generalizability of the framework in practice.
Questions for authors
- Could the authors discuss if the anchored control volume approach can be extended to problems where the initial state is not known exactly (e.g., inverse problems or noisy data)?
- Regarding the hand-tuned hyperparameters, do the authors have suggestions for a more automated way to determine parameters (like gate threshold) across different physics problems?
- How does the method compare against classical solvers for these problems, especially classical shock tracking algorithms?
3 comments
Author Response to Reviewer 4aJq Part 2
Q1. Noisy data.
Thank you for this thoughtful question. We now include an extended robustness experiment by adding noise to the initial conditions of Shu-Osher. This extended experiment is in the revised manuscript under Appendix E.3 lines [1612-1619] and Table 11 lines [1647-1662]. The key result is that this experiment suggests that FLINT is robust to noise. To test this, we trained FLINT with the reported configuration for Shu-Osher, with no changes to the method, but initial data corrupted by random noise in all three variables, and scored it against the WENO5 reference. The noisy initial data are
\tilde{u}(x) = u_0(x) + \sigma\, c_0(x)\, n_u(x), \quad \tilde{p}(x) = p_0(x)\,\bigl(1 + \sigma\, n_p(x)\bigr),$$ where $\rho_0$, $u_0$ and $p_0$ are the exact initial density, velocity and pressure, $\sigma$ is the noise level, and $c_0 = \sqrt{\gamma p_0 / \rho_0}$ is the local sound speed with $\gamma = 1.4$, which sets the size of the velocity noise. The noise $n_\rho$, $n_u$ and $n_p$ is drawn from a standard normal distribution, $\mathcal{N}(0, 1)$, independently for each variable. **W5 + Q2. Hyper-parameter selection.** Thank you for this important question. To our knowledge, the baselines we compare against do not give a procedure for choosing their settings on a new problem. PINNs-WE reports its settings for each problem without saying how they were chosen. WE-PINN fixes its loss weights to 1 and chooses its network and quadrature from a sweep scored against the exact Burgers solution. At submission we used the same approach and chose our settings for each problem against the WENO5 reference. We acknowledge that this is not practical for a new problem, where no reference exists. **Per the reviewer's suggestion, we have explored a more practical approach. We have now developed a set of rules, as advice for future practitioners that do not depend on the reference solution, which we include in the revised Appendix H lines [1818-1889] Our original prescription and experiments remain unchanged. Additionally, we found a single configuration that works across all of the problems presented. We found that taking the Shu-Osher configuration and using the rules described in the revised Appendix H provides results very close to the results reported in the paper.** **Q3. Comparison with classical solvers and shock tracking.** We thank the reviewer for this important question and agree that classical solvers are the right standard for these problems. We used **WENO5 as the classical reference** for Sod-$k$ and Shu-Oshe. On these one dimensional problems classical solvers are much faster than PINNs, and WENO5 with 800 cells reaches errors comparable to those of FLINT in about one second on one CPU core. We agree that shock tracking and shock fitting schemes (Glimm et al., 1981; Chern et al., 1986; Moretti, 1987; Salas, 2010) are an appealing way to treat these flows. **To address this question we ran the shock tracking algorithm of Glimm et al., 1981 and Chern et al., 1986. and the results are in the revised manuscript in Appendix I lines [1893-1991].** **The key result is that the shock-tracking solutions converge toward the reference solutions used throughout this paper. This provides additional confidence in our evaluation of FLINT and the baselines, suggesting that our conclusions are not strongly dependent on the choice of reference solver.** **While FLINT does not outperform traditional solvers in one dimension, it does outperform the SOTA in the PINN literature, and is a step towards the practical application of PINNs in this space.** We find that our loss straightforwardly extends to two dimensions, where it has the lowest error among the PINN methods we tested on the quadrant Riemann problem **see reviewer iU9n W3**, and we hope it helps future PINNs handle these scenarios.Follow-Up to Author Responses and Revisions
Dear reviewer 4aJq: Thank you again for your time and constructive feedback. We have provided point-by-point responses and additional experimental results, and hope these address your concerns.
As the discussion deadline approaches, we would appreciate it if you could review our replies when your schedule permits. Please let us know if anything remains unclear or requires further clarification. We are more than delighted to have further discussions and improve our manuscript. If our response has addressed your concerns, we would be grateful if you could re-evaluate our work.
Author Response to Reviewer 4aJq Part 1
We thank 4aJq for their thoughtful review. We will address each of your comments and questions here.
W1. Incremental, shock-specific contribution, tested only on toy problems without classical solver baselines, and with unsupported higher-dimensional claims. First we thank the reviewer for suggesting we pursue a higher-dimensional problem, as the extension of FLINT to higher spatial dimensions is straightforward, we now provide an extension to a 2D problem in Section 4.4 lines [475-506] with additional information including in Appendix A.5 lines [1176-1225]. The key result of extending FLINT to two dimensions is that it outperforms the baselines in 14 of the 16 reported metrics, with only marginal differences in the remaining two.
Regarding novelty of contribution, we direct the reviewer to our response to W1 from reviewer iU9n.
Regarding the toy nature of the test problems and comparison to state of the art: we note that we do compare to industry standard high-resolution shock capturing methods including a finite volumes scheme with both a limited linear and WENO5 reconstruction. In hypersonic flows, unresolved shocks, often interacting with complex wave structure, are nearly ubiquitous. It is for this reason that most traditional solvers for hypersonic systems include the Shu-Osher test in their verification suites. So while we have not modeled the nearly unlimited set of flow structures, we believe we have chosen a relevant representative subset.
W2. Additional theoretical analysis. We would like to thank the reviewer for acknowledging the inclusion of Prop B.1 with stating that proposition (B.1) combined with the linear-advection experiments provide a clear theoretical explanation for why small PDE residuals do not necessarily guarantee accurate wave recovery.
FLINT is a neural network based optimization method for PDE problems. We believe that our method is evaluated thoroughly and our claims are supported empirically.
In regards to additional theoretical analysis, we would appreciate guidance from the reviewer as to which parts (and/or components) lacks theoretical support.
W3. FLINT is costlier than finite-volume solvers, and the higher-dimensional benefit names no concrete problem with shocks. We thank the reviewer for suggesting a more careful analysis of cost. We now include a full study and ablation in the revised manuscript, Appendix D lines [1449-1457,1486-1499], Figure 18 lines [1535-1559] and Table 9 lines [1512-1533]. To convey matched computational budgets we increased the number of iterations to meet FLINT where necessary and we also matched FLINTs run times. The key result is the improvements persist under these matched budgets, since FLINT is both the fastest and the most accurate method on Sod-k, and on Shu Osher the baselines do not reach FLINT's accuracy even when they are given more training time, and they still lose the entropy wave that FLINT resolves. The trade-off for Shu-Osher is accuracy over a longer training time and this is something we will continue to investigate in future work.
Regarding the presence of higher-dimensional PDEs with or without shocks: we primarily mean three-dimensional fluid flows coupled to kinetic/transport systems, which are descried by a six-dimensional Boltzmann equation. For transport of, e.g., chemical particulates or ion species, these flows are particularly important for engineering applications such as semiconductor manufacturing and hypersonic vehicles (Anderson, 2006; Candler, 2019). If the transported field is photons, its coupling to the gas produces a rich phenomenology of radiation shocks (Mihalas and Weibel-Mihalas, 1984; Lowrie and Edwards, 2008), with applications that include laser fusion and reentry vehicles. We have revised the outlook of the manuscript to include these examples.
W4. The effects of the architecture and the loss are not separated, and a network that outputs the discontinuity directly may capture shocks better. We thank the reviewer for this helpful question and agree that the role of the network should be separated from that of the loss. We have added a network size ablation in Appendix E.2 lines [1598-1610] and Table 10 lines [1620-1645] of the revised manuscript. The key result is that the network capacity does have an impact on the overall optimization process. Lowering the network capacity with all other settings fixed, is unable to capture the wave structure in both Sod-k and Shu-Osher. Furthermore, increasing the capacity of the network does not necessarily lead to better performance.