- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes Predict-Project Transformer (P2T), a neural fluid simulator that combines graph neural networks (GNNs) and Transformers in a physics-inspired architecture. Motivated by the predictor-projection decomposition of incompressible fluid simulation, the method uses message passing to capture local particle interactions and latent attention to model global dependencies. Experiments on weakly compressible SPH datasets demonstrate that the proposed method effectively captures both local and global fluid dynamics, outperforming baseline methods on most evaluation metrics.
Critical strengths
-
The proposed method draws inspiration from the predictor-projection structure of incompressible fluid simulation to guide the integration of local message passing and global attention. Although the corresponding physical properties are not explicitly guaranteed, the experimental results demonstrate the effectiveness of this architectural design.
-
The ablation experiments demonstrate that the proposed sequential combination of local and global components, together with the skip connection, substantially improves long-horizon prediction accuracy compared with alternative configurations.
Critical weaknesses
-
The connection between the physical formulation and the proposed neural architecture is not sufficiently validated. The derivation from the physical equations primarily serves as an architectural motivation, while the corresponding physical properties are neither explicitly enforced nor theoretically guaranteed. Specifically, the main connection between Eq. (4) and Eqs. (5)–(7) appears to be the introduction of near-field and far-field features, where the far-field features are conditioned on the near-field features, and the two are combined through a skip connection before decoding the predicted accelerations. However, it remains unclear whether the resulting neural simulator actually approximates the physical decomposition in Eq. (4). For example, does the global attention module learn a physically meaningful pressure-related correction? Do the learned interaction maps or the Jacobian of the complete state-transition function quantitatively resemble those of Eq. (4)? Furthermore, can the method preserve physical properties such as incompressibility, or at least reduce violations of the corresponding constraints? Additional theoretical analysis or quantitative evaluation would strengthen the connection between the physical formulation and the proposed architecture. It would also be useful to clarify whether the architectural design is applicable to other fluid models whose governing equations do not admit the same predictor-projection decomposition.
-
The physical formulation and the simulation data rely on different fluid models. Eq. (4) is derived from an incompressible SPH (ISPH) projection method, whereas the training datasets are generated using a weakly compressible SPH (WCSPH) solver. Although the authors discuss this distinction and provide a qualitative justification based on acoustic propagation over multiple solver substeps in Appendix C, the equivalence between these two formulations is not fully established. This raises two questions. First, can the proposed method achieve similarly strong performance on datasets generated by an incompressible SPH solver, particularly in terms of maintaining the divergence-free condition? Second, to what extent does the near-field/far-field decomposition derived from Eq. (4) accurately describe the dynamics of the WCSPH datasets? A more quantitative analysis of this correspondence, especially for the more violent dam-break scenario, would help validate the physical motivation.
-
The mathematical descriptions of the architectural configurations could be clearer. The ablation experiments compare three configurations: P2T, parallel, and no-skip. However, only the proposed P2T configuration is explicitly formulated in Eqs. (5)–(7). Although the parallel and no-skip configurations are described in the final paragraph of Section 4, providing their explicit mathematical formulations would make the architectural differences easier to understand and the experiments easier to reproduce. In particular, it would be helpful to clarify which residual connections are removed in the no-skip configuration, given that the Transformer blocks themselves contain internal residual connections, as shown in Eq. (16).
-
Some presentation and layout issues reduce readability. Page 8 contains several figures and tables arranged rather densely, making it difficult to identify and follow the key experimental results. A clearer layout would improve readability.
-
The evaluation of generalization remains limited. First, the transfer-learning experiments focus on related two-dimensional wave-tank scenarios. Although the model is designed to scale to large particle systems, its generalization to more complex three-dimensional fluid dynamics has not been demonstrated. Second, the transfer experiments in Figure 6 primarily report training and validation losses, without corresponding quantitative long-horizon rollout metrics or qualitative comparisons of the predicted dynamics. Such evaluations would provide stronger evidence that the improvements in one-step prediction loss translate into accurate long-term simulation. Finally, videos of the predicted rollouts, particularly for the transfer scenarios, would help assess temporal coherence and the physical plausibility of the simulated dynamics, which are difficult to evaluate from isolated snapshots alone.
Questions for authors
See weaknesses.
2 comments
Response to Reviewer (2/2)
2. The physical formulation and the simulation data rely on different fluid models.
“Can the proposed method achieve similarly strong performance on datasets generated by an incompressible SPH solver, particularly in terms of maintaining the divergence-free condition?”
Recently published work used a 3D dataset generated using divergence free SPH (one type of incompressible SPH method) for training [3]. After training on their published dataset and comparing to their model checkpoint, we find both qualitatively and quantitatively that P2T generates the most accurate rollouts, consistently outperforming the state of the art and dramatically outperforming their baselines. We provide the quantitative comparison below, have included the qualitative visual comparisons in the revised paper’s appendix, and have included video rollouts at https://sites.google.com/view/predict-project-transformers. We are also currently training the baseline models from our paper on this dataset for a more extensive comparison.
| Model | 0.5 s | 1 s | 2 s | 3 s | 4 s | 5 s | 6 s |
|---|---|---|---|---|---|---|---|
| WorldParticle | 0.000886 | 0.00855 | 0.0617 | 0.226 | 0.270 | 0.300 | 0.325 |
| P2T | 0.000320 | 0.00465 | 0.0520 | 0.205 | 0.227 | 0.251 | 0.273 |
[3] Wang, Caoliwen, et al. (2026) WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformer. To appear in SIGGRAPH ASIA 2026.
“Second, to what extent does the near-field/far-field decomposition derived from Eq. (4) accurately describe the dynamics of the WCSPH datasets?”
Instead of using a predictor-projection decomposition, WCSPH propagates acoustic and material forces locally at dramatically different speeds. These two speeds effectively define local and global interactions when sampled at larger time steps. For example, in one step in the dam break dataset, acoustic information propagates through most of the tank (3.4 m in a 4 m tank) while material propagates 0.035 m.
Since WCSPH and ISPH describe the same fundamental system, we expect that a general architecture capable of learning the dynamics of one solver should also be able to learn the dynamics of the other. We verified this using WCSPH data (wave tank and dam break) and the newly acquired ISPH data mentioned above.
3. The mathematical descriptions of the architectural configurations could be clearer.
We agree that the motivation for the ablations could have been clearer, and we have clarified this in the revision. Equations for each ablation are in the revised paper's Appendix A. Here we provide explanations of the relevance of each ablation.
Both ablations are small routing changes that do not change parameter counts. In the parallel configuration, both the predictor and projector use the encoded features and their outputs are summed for the decoder. This ablation tests if local and global operations alone are enough, or if the predictor outputs provide crucial information to the projector.
In the no-skip configuration, we remove the direct residual connection from local outputs to the decoder. However, there are still per-layer residuals in every block (message passing, encoder, attention) that allow for the uninterrupted propagation of residual activations throughout the entire network. Notably, the no-skip configuration is standard for hierarchical networks such as UPT and GIOROM, and P2T differs from this configuration by one residual connection.
We find that ablating either increases rollout error by >2.8x, meaning that both of the ablated connections are crucial for rollout stability.
4. Some presentation and layout issues reduce readability.
We appreciate this feedback and have made organizational improvements. All figures appear next to the text that references them exception for appendix figures which are explicitly labeled. We also made a small change so that all figures appear in the same order that they are referenced. We hope that this leads to a smoother reading experience.
5. The evaluation of generalization remains limited.
“Although the model is designed to scale to large particle systems, its generalization to more complex three-dimensional fluid dynamics has not been demonstrated.”
As mentioned above, our revised paper includes training results on a 3D SPH dataset where we do much better than the state-of-the-art. Furthermore, we would like to emphasize that our 2D simulations contain more particles than the largest 3D fluid datasets we are aware of, including this new dataset.
“The transfer experiments in Figure 6 primarily report training and validation losses.”
We have added qualitative comparisons that we hope are sufficient to showcase P2T’s ability to learn from a few examples. The paper now includes comparisons of P2T rollouts before and after finetuning. Videos comparing performance before and after fine-tuning can be found at https://sites.google.com/view/predict-project-transformers
Response to Reviewer (1/2)
We thank the reviewer for their thorough feedback on our paper and hope our response can help provide clarity to the reviewer’s concerns.
1. The connection between the physical formulation and the proposed neural architecture is not sufficiently validated.
We agree and apologize for the unclear writing. We did not design P2T to learn a specific fluid dynamics implementation, but to use ISPH’s clean structure as a set of inductive biases for a general-purpose fluid network. Our original draft was unclear and we have changed the use of terms such as “confirms” and “is consistent with” to reflect this.
We find empirically that these design choices are supported in P2T. On maintaining near-incompressibility (measured by density deviation), P2T ranks first on wave tank and second on dam break after GNS. However, we note that on both datasets P2T’s ability to maintain near-incompressibility is many times stronger than all other transformer-based baselines, and that configuring P2T’s predictor and projector like in the ISPH equation is crucial for strong overall performance.
Finally, in practice both modern ISPH implementations and WCSPH differ slightly from this analysis even though they all describe the same physical system. In that sense, our approach is similar to how neural operators [1,2] assume that many PDE solutions can be written in terms of integral operators, even though this is not a strict requirement and the actual simulators may do additional computation under the hood.
[1] Li, Zongyi, et al. (2021) Fourier neural operator for parametric partial differential equations. International Conference on Learning Representations
[2] Yang, Zherui, et al. (2026) Simple yet Effective: Low-Rank Spatial Attention for Neural Operators. Forty-third International Conference on Machine Learning
Our goal is not to learn a specific operation such as pressure correction but to show that a network that is structurally similar to ISPH can effectively learn fluid simulation generally.
DualSPHysics does not provide gradients, preventing direct computation of reference interaction maps. However, we empirically computed Knear and Kfar from Eq. (4) to determine if P2T’s predictor and projector resemble the structure of Eq. (4). We found that, Knear is banded with nonzero entries only between neighbors of a fixed radius and Kfar is dense. This is trivially true for any message passing subnetwork and latent attention subnetwork respectively. Below we also report the singular values of the interaction map, normalized by the largest singular value. We see that Kfar is effectively rank 2 while Knear has a much higher rank. This aligns with the P2T interaction maps shown in the last page of the appendix, where the predictor contributes a target-specific ring while the projector contributes a global pattern that is shared across all targets.
Finally, as stated above, we find that P2T does achieve a level of near-incompressibility similar to the ground truth simulator and drastically above other attention-based networks. This is reported in Table 2 of the main manuscript.
P2T already demonstrates strong performance on WCSPH which does not admit an explicit predictor-projection decomposition. Our experiments show that P2T’s recreated dynamics are by far most physically accurate, and we also find P2T surpasses the existing state of the art on a 3D incompressible formulation of SPH (results discussed below).