- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper provides a new method for modeling turbulent flows. The proposed approach uses models for predicting coarse and fine regions which is intuitively similar to large-eddy simulations in traditional computational fluid dynamics. Results in the main paper and appendix show better quality of predictions than a few popular baselines. However there are many important results that are hidden away in the appendix, and the main paper only shows mean squared error metrics. Thus, the approach and results and promising, but the main manuscript could be revised for better reporting of a valuable contribution.
Edit 1: Increasing score to accept since all concerns are addressed. Good paper with method that beats strong baselines in stats and physics metrics.
Critical strengths
- Proposed modeling approach is intuitive and is shown to be stronger at predicting turbulent flow fields than a variety of baselines.
- Paper is well documented with extensive set of physics-related analyses and training details and experiments have been designed to be reproducible.
Critical weaknesses
- Many of the important results are hidden away in the appendices.
Questions for authors
-
Baseline configurations: Several baselines have been downsized to satisfy GPU memory constraints. To what extent do the authors anticipate that the conclusions would change if larger baseline configurations were used?
-
Physics-based evaluation: The paper primarily uses NMSE of the predicted flow fields to evaluate model performance. The appendix includes additional physics-related analyses, such as turbulence energy spectra. It would be useful to include quantitative metrics based on turbulence spectral statistics, divergence errors, and conservation-law residuals in the main paper. Could the authors expand the evaluation to include these metrics?
-
Connection to classical turbulence modeling: The proposed approach appears closely related to classical large-eddy simulation (LES), subgrid-scale closures, and multiscale turbulence modeling. Could the authors include a brief discussion connecting these concepts to their approach, particularly highlighting the physical principles motivating the architecture and how it differs from conventional filtered-equation methods?
4 comments
Continued
Q3. Connection to LES and classical turbulence modeling
Response. Thank you for your thoughtful question. We agree that the connection to large-eddy simulation (LES) and to multiscale turbulence modeling helps to explain the physical principles behind our design.
The design of ScaleSplit-NO rests on the scale structure of turbulence. Large structures are correlated across broad regions of the domain and can be represented on a coarse grid. In contrast, small structures are correlated only over short distances. LES also rests on this scale structure. LES resolves the large scales on a coarse grid and represents the effect of the unresolved small scales with a subgrid-scale model. In ScaleSplit-NO, the Parent predicts the large scales on a coarse grid. The coarse fields on which the Parent is trained are obtained by truncating the full-resolution fields to the low frequencies and sampling the result on the coarse grid. These coarse fields correspond to the filtered fields of an LES with a sharp spectral filter.
Beyond the large scales, ScaleSplit-NO also predicts the full-resolution field, with the Child predicting each local patch from the coarse prediction of the Parent. The Child receives this coarse prediction as a condition, interpolated to the fine grid and cropped at the patch location. The condition supplies the large-scale motion that the patch does not contain. The physical basis of this design is that the small scales at one location are shaped mainly by the large-scale motion around this location and only weakly by the small scales elsewhere in the domain [R3.3].
In numerical simulation, a method more closely related to this design is grid nesting, which rests on the same physical principle. In grid nesting, a coarse grid covers the whole domain and drives the computation on fine grids placed on local regions. Grid nesting has long been used in numerical weather prediction [R3.1] and is also applied to LES [R3.2]. In grid nesting, a fine-grid computation needs to cover only a local region, because the rest of the domain influences the local region mainly through the large-scale motion provided by the coarse grid. The cost of the fine-grid computation then depends on the size of the local region and not on the size of the whole domain. For ScaleSplit-NO, this principle allows the training memory to be set by the patch size and the coarse grid, so that the training memory does not grow with the resolution of the field.
ScaleSplit-NO differs from filtered-equation methods such as LES in two ways. First, LES advances the large scales by solving the filtered equations, in which a subgrid-scale model represents the effect of the removed small scales. In ScaleSplit-NO, the Parent instead learns the evolution of the large scales directly from the filtered fields of the data, whose evolution already includes this effect, so no subgrid-scale model is needed. Second, LES does not compute the small scales, whereas in ScaleSplit-NO the Child predicts them in each patch, which yields the full-resolution field.
Following your helpful suggestion, we have added the connection to LES and grid nesting to Section 3 (p. 3) of the revised manuscript.
Thank you again for your careful reading and helpful comments, which have helped us strengthen the physical evaluation and clarify the connections to classical turbulence modeling.
[R3.1] N. A. Phillips and J. Shukla, "On the strategy of combining coarse and fine grid meshes in numerical weather prediction," Journal of Applied Meteorology and Climatology, 12(5), 763–770, 1973.
[R3.2] C.-H. Moeng, J. Dudhia, J. Klemp, and P. Sullivan, "Examining two-way grid nesting for large eddy simulation of the PBL using the WRF model," Monthly Weather Review, 135(6), 2295–2311, 2007.
[R3.3] H. Tennekes, "Eulerian and Lagrangian time microscales in isotropic turbulence," Journal of Fluid Mechanics, 67(3), 561–567, 1975. (cited in the paper)
Thank you on extending the analysis and the discussion. I learnt a lot from this exchange. All concerns addressed. Raising score from 3->4. Good luck!
Thank you for your feedback and for raising your score!
We sincerely appreciate your thorough review and positive feedback. It is especially encouraging to hear “All concerns addressed.” Your thoughtful questions and constructive suggestions have helped us strengthen the manuscript. Thank you again for the time and effort you have devoted to this helpful exchange.
Thank you for your thoughtful and constructive feedback
Thank you for your careful reading and the constructive review. We appreciate your recognition that the proposed approach is intuitive and stronger at predicting turbulent flow fields than a variety of baselines, and that the paper is well documented and designed to be reproducible. We take this opportunity to address each of your concerns below.
Q1. Larger baseline configurations
Response. Thank you for this important question. To test larger baseline configurations, we used GPUs with 96 GB of memory to retrain all six baselines with larger configurations on JHTDB256 using 1/8 of the training data. The detailed results are given in the common response C1 (Tables R1 and R2 in C1). As shown in Table R2, all enlarged baselines remain less accurate than ScaleSplit-NO. The strongest of them, P3D-L, reaches an NMSE of 2.27 × 10⁻³, compared with 1.25 × 10⁻³ for ScaleSplit-NO. With the larger configurations, U-Net, EddyFormer, and P3D improve, while FNO, MG-TFNO, and ReViT change little. The enlarged baselines use 52 to 88 GiB of training memory, 17 to 29 times the 3.0 GiB required by ScaleSplit-NO. The conclusions of the paper therefore hold with the larger baseline configurations. We have included these results in the appendix of the revised manuscript (Appendix B.2, pp. 16–17).
W1 & Q2. Physics-based evaluation in the main paper
Response. Thank you for your suggestion. We have added these metrics to the main paper (Table 2 in Section 4.1, p. 7, Table R8). For all methods trained with 1/8 of the data, Table 2 reports the spectral error in a low, a middle, and a high wavenumber band, the divergence error, and the residual error of the mass equation on MHD64 and of the momentum equation on JHTDB256. The divergence and residual errors compare the prediction with the ground truth, because the ground truth itself does not satisfy the discretized equations on the evaluation grid. ScaleSplit-NO has the lowest error in every metric on both datasets. At low wavenumbers, the most accurate methods are close to each other, and the differences arise at high wavenumbers. There, several baselines have errors close to or above 100%, so they predict the small scales hardly better than leaving them out, whereas ScaleSplit-NO keeps the error of these scales near 10%. The divergence and the residual involve spatial derivatives, which give greater weight to high-wavenumber components, and are therefore most sensitive to errors at small scales. ScaleSplit-NO also achieves the lowest divergence and residual errors on both datasets. The definitions of the metrics are given in Appendix B.6, pp. 27–28.
Table R8. Physics-based metrics of one-step predictions with 1/8 of the training data, averaged over all test pairs (Table 2 in the revised manuscript, p. 7). The spectral error is given in three wavenumber bands, k ≤ 8, 8 < k ≤ 16, and k > 16 on MHD64, and k ≤ 32, 32 < k ≤ 64, and k > 64 on JHTDB256. The divergence error is that of the magnetic field on MHD64 and of the velocity on JHTDB256, and the residual error is that of the mass equation on MHD64 and of the momentum equation on JHTDB256.