- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper explores the use of low-fidelity simulations as supervised pretraining data for neural surrogates, and demonstrates improved downstream fine-tuning accuracy on unseen engineering benchmarks and cross-operator tasks compared with training from scratch and geometry-based GeoPT pretraining. The paper further studies the effects of source-corpus scale, model capacity, downstream data availability, and physical-condition diversity.
Critical strengths
strengths:
-
The paper constructs sizable fluid and solid-mechanics simulation corpora for studying pretraining and transfer of neural surrogates. The curated datasets and associated pipeline could be useful to the community for future research on surrogate pretraining and transfer learning.
-
The paper evaluates its pretraining approach across a reasonably broad set of downstream settings, including cross-operator transfer from CFD to acoustics and electrostatics and a separate extension from solid-mechanics pretraining to deformable-body benchmarks. This breadth helps characterize where the proposed pretraining strategy transfers successfully and where its benefits are less consistent.
Critical weaknesses
weaknesses:
There are two variables in the proposed pretraining scheme: 1. low-fidelity 2. supervised pretraining with curated dataset, and my main concern is that the current experiments don't fully justify the merits on both factors.
-
a low-fidelity vs. high-fidelity pretraining comparison is missing. It would be valuable to validate the promise of low-fidelity-based pretraining on whether it would help the surrogate achieve better downstream adaptation with similar data generation time, or similar downstream accuracy with less data generation time.
-
Although the datasets are used for supervised pretraining, there isn't a baseline of model with supervised pretraining with alternative datasets. A justifiable starting point would be collecting off-the-shelf datasets such as DrivAerNet++ [1], AhmedML [2], and HiLiftAeroML[3] just to name a few, besides ones mentioned in this paper, and use a mixture of them as the supervised pretraining baseline. This comparison would help clarify if the curated dataset is more valuable than off-the-shelf public datasets in downstream task transfer as in the current setup
[1] Elrefaie et al., DrivAerNet++: High-Fidelity Computational Fluid Dynamics & Deep Learning Benchmarks
[2] Ashton et al., AhmedML: High-Fidelity Computational Fluid Dynamics Dataset for Incompressible, Low-Speed Bluff Body Aerodynamics
[3] Ashton et al., HiLiftAeroML: A High-Fidelity Computational Fluid Dynamics Dataset for High-Lift Aircraft Aerodynamics
Questions for authors
See W1 and W2 for requests for additional evidence that will isolate and validate the core contributions.
5 comments
Dear Reviewer,
As the discussion period is closing soon, we would like to kindly follow up.
For your W2 (a supervised-pretraining baseline on off-the-shelf public datasets), we compared against the CD-CFD checkpoint, pretrained on a mixture of six high-fidelity public CFD datasets including DrivAerML and DrivAerNet++, with the same AB-UPT-24M backbone. Our low-fidelity pretraining transfers better on all three held-out benchmarks. This also resolves W1: high-fidelity pretraining at a much larger generation cost brings weaker downstream adaptation than our corpus.
Could you let us know whether this addresses your concerns, and if so, whether you would consider updating your rating? We are happy to provide any detail further.
Dear Reviewer,
We understand this is a busy period, and we would like to send a last brief note before the discussion closes.
Your review identified two questions to justify, and our additional experiments along with the revision now test both directly:
- W2 (a supervised baseline pretrained on off-the-shelf datasets): we compared against the CD-CFD checkpoint, pretrained on six high-fidelity CFD datasets including DrivAerNet++, with the same AB-UPT-24M backbone. Our low-fidelity corpus transfers better on all three held-out benchmarks (Table 7).
- W1 (low vs. high fidelity at comparable generation time): the generation budget of our full corpus would produce only about 35 DrivAerML-scale high-fidelity cases. The CD-CFD comparison above futher proves that our low-fidelity pretraining yields better downstream accuracy at a much lower generation cost.
In addition, following other reviewers, we pretrained on our own geometries with a geometry-only objective, which shows that the benefit actually comes from the simulated physical responses.
Your reply on whether these address your concerns would be very helpful to us and to the AC. Thank you so much for your time.
(1/1) Response to Reviewer x3c4's comments
We are grateful for the reviewer’s valuable comments and insightful suggestions. Our detailed responses to the concern are as follows, and please refer to the updated PDF, with all changes highlighted in blue.
Low-Fidelity Pretraining versus Public CFD Pretraining: Generation Cost and Downstream Transfer (W1, W2)
Thank you for these closely related suggestions. We address them jointly by examining both the time required to construct the pretraining corpus and the downstream performance of pretraining on existing public CFD datasets.
Generation scale within a fixed simulation time. Our low-fidelity pipeline generates each case in approximately 542 seconds on one A100 GPU, requiring approximately 1,406 GPU-hours for the 9,336-case corpus. For comparison, a typical DrivAerML simulation requires approximately 40 hours on 1,536 CPU cores. Over the same cumulative simulation wall-clock time, this setup would produce only approximately 35 high-fidelity cases, which is scarce to support pretraining. Although the hardware differs, this comparison illustrates the substantial practical barrier to constructing a large and diverse high-fidelity pretraining corpus.
Comparison with large-scale public-data pretraining. To evaluate whether existing public CFD datasets offer a stronger alternative, we additionally compare against the CD-CFD [1] pretrained checkpoint using the same AB-UPT-24M backbone on Aircraft, Car-Crash, and NASA-CRM as DrivAerML is part of the CD-CFD pretraining corpus. CD-CFD draws on six high-fidelity public CFD datasets (e.g., DrivAerML, DrivAerNet++) whose original simulation generation required substantial computational resources. Nevertheless, our low-fidelity initialization demonstrates stronger downstream adaptation compared with large-scale high-fidelity public-data pretraining.
Together, these results support low-fidelity simulation as a practical source of scalable, reusable pretraining supervision: it enables broad source-data coverage without the generation burden of high-fidelity corpora, while retaining substantial downstream transfer value. We have incorporated this discussion into Section 6.5 of the revised paper.
Summary
We sincerely thank you for your thoughtful and constructive review. We greatly appreciate your recognition of our curated simulation corpora and pipeline, and we hope that our new experiments comparing our low-fidelity curated corpus vs. off-the-shelf high-fidelity public CFD dataset mixtures on pretraining fully address your concerns.
Reference
[1] Anthony Zhou, et al. "Cross-Domain Pretraining for Steady-State Neural CFD Surrogates."