- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes the Point-Set Local Transformer (PLT), a neural operator architecture for irregular point sets and high-resolution physical fields, aiming to reduce the computational and GPU memory overhead of large-scale physical field prediction. PLT adopts an encoder–decoder structure and mainly includes the following designs:
- Local Weighted Attention: Center points are selected via Farthest Point Sampling (FPS); spherical neighborhoods and center-to-neighbor cross-attention are used to aggregate local information; and geometric positional biases and quadrature weights are introduced into the attention logits.
- Global Information Interaction: Low-dimensional global token aggregation based on Efficient Attention is used to enable cross-region information propagation while avoiding a full point-to-point attention matrix.
- Independent Query Decoding: The encoder produces fixed center-point representations, and the decoder independently predicts outputs for arbitrary query locations. Since there is no direct interaction among query points, the model can use chunked inference to reduce peak GPU memory without changing the prediction results (within numerical precision).
Critical strengths
-
A practically valuable architecture design, especially low-memory prediction for large-scale output fields. PLT combines point-set local geometric aggregation, global communication, and independent query decoding, enabling the encoded representation to be reused across different output queries. Compared with architectures that must jointly process all output points, this design offers clear practical advantages in high-resolution physical field prediction. In particular, on SuperWing, after partitioning the complete output into multiple query chunks, peak GPU memory decreases from 0.591 GiB to 0.322 GiB, while the prediction results remain consistent within numerical tolerance. The authors also report a corresponding increase in inference latency, making the trade-off between memory and speed relatively transparent. This design is of practical significance for scientific computing tasks whose output grids are much larger than the model's internal representation size.
-
The experiments cover a relatively broad range and include large-scale aerodynamics tasks of practical relevance. The paper evaluates not only standard operator learning tasks such as Elasticity and Plasticity but also validates physical field prediction on real 3D complex geometries in SuperWing and HiLiftAeroML. The error reduction on Plasticity is relatively significant, and the pressure prediction results on SuperWing are also competitive. The native-surface full-field prediction on HiLiftAeroML further demonstrates the architecture's ability to handle ultra-high-resolution outputs. Compared with works that only demonstrate synthetic data or smaller-scale PDE benchmarks, this experimental design combining standard tasks with industrial-scale problems has high practical value.
Critical weaknesses
-
HiLiftAeroML lacks baseline comparisons under a common evaluation protocol.
HiLiftAeroML is a central experiment supporting the paper’s industrial relevance. However, the results from prior work shown in Figure 12 differ from those of PLT in terms of data splits, evaluation locations, and error-weighting schemes. Although the authors acknowledge these limitations, the comparison is still insufficient to establish PLT’s relative performance. At a minimum, several representative baselines should be evaluated directly using the same data splits, input sampling, and evaluation metrics.
-
The core novelty needs to be clarified.
The main components of PLT are closely related to existing methods such as PointNet++, Efficient Attention, OFormer, UPT, and SMART, and its contributions appear to lie primarily in technical integration and efficient implementation. The authors should further clarify which design choices are critical to the performance gains and what distinctive advantages PLT offers over existing local–global hybrid architectures. Comparisons and discussion with other local–global multiscale architectures are also missing from the baseline evaluation.
-
The independent contribution of quadrature weighting remains unclear.
Table 5 removes both the quadrature weights and the relative positional bias simultaneously, making it impossible to distinguish their individual contributions. Separate ablations are recommended. Moreover, since the primary motivation for this mechanism is to reduce bias caused by nonuniform sampling, its benefits would be more appropriately evaluated under varying sampling densities, local oversampling, and cross-discretization settings. Appendix C states that the downsampled center points directly inherit their original weights. However, FPS changes the spatial distribution of the points, so the authors should also explain how these inherited weights continue to provide a reasonable quadrature approximation at the center level.
-
The conditional modulation mechanism lacks experimental validation.
The paper uses adaLN-Zero to incorporate temporal or physical conditions but does not compare it with simpler alternatives, such as concatenating the conditioning variables with the input features. It therefore remains unclear how much this design contributes to performance.
-
The computational cost comparison remains incomplete.
The model uses FPS and neighborhood construction, but the scalability experiments adopt uniform random sampling and exclude offline sampling and neighborhood search from the timing measurements. Consequently, the reported runtimes do not fully reflect the cost of using the model on real geometries. The authors should report geometry preprocessing times for actual tasks and distinguish between processing a new geometry for the first time and reusing an existing geometry. In addition, baseline GPU memory measurements are missing from Table 6, preventing a comprehensive assessment of PLT’s overall resource advantages. The reported TFLOPs for PLT differ from those of the baselines by an order of magnitude. The authors should standardize the FLOP-counting methodology or explicitly clarify where the figures are not directly comparable. They should also distinguish whether reductions in arithmetic cost arise from architectural design, compression budgets, or differences in the scope of the computation being counted.
-
Sampling budgets and accuracy–cost trade-offs have not been validated on realistic aerodynamic tasks.
Figure 7 measures only the computational cost on synthetic point clouds, while the ablation on Elasticity is insufficient to establish how accuracy changes on complex aerodynamic tasks. The authors should vary the number of input points, the number of centers, and the neighborhood budget on SuperWing or HiLiftAeroML, while jointly reporting error, GPU memory usage, and runtime. This would help validate the accuracy–cost trade-off and robustness to changes in sampling density.
Questions for authors
If the authors can address my core concerns, I will consider raising my score.
4 comments
Response to Reviewer ieNP - Part 2 of 2
ieNP-W5 — Geometry preprocessing, GPU memory, and FLOP comparisons
For fixed geometry and sampling, FPS and source neighborhoods can be precomputed and reused across epochs and predictions. We profiled three HiLiftAeroML test geometries on an NVIDIA A100 80GB PCIe, reporting medians over three repetitions. Input preparation (including FPS and neighborhood searches) takes 0.350–0.367 s for 1,048,576 sampled inputs and 8,192 centers (). Full-field query-neighborhood construction takes 63.75–73.09 s for 126–140 million output locations in 8,192-query chunks. Peak allocated GPU memory is 0.141 GiB for preparation and 0.115 GiB for query processing. These timings will be added to the revised manuscript.
The baseline results in Table 6 are taken from Giral et al. (2026, Table 2), who did not report GPU memory usage. Accordingly, we leave these entries unreported.
Our FLOP counting follows the released AeroJEPA evaluator's forward-inference convention (NVIDIA PhysicsNeMo): two operations per multiply–add, including PLT's fused local-attention arithmetic. Model sizes and compression budgets differ: our instantiation of AeroJEPA using Giral et al.'s Table 3 dimensions has 11.81M inference parameters, versus 1.31M for PLT. PLT's compact architecture achieves lower pressure error in Table 6 with substantially fewer parameters and operations, highlighting its architectural effectiveness. We will clarify this distinction in the revision.
ieNP-W6 — Accuracy–cost trade-offs across sampling budgets
We have extended the SuperWing evaluation to four center budgets and three neighborhood caps, using the same backbone, training settings, and 32,768 input points. These experiments show that reducing the neighborhood cap provides substantial memory and runtime savings with modest changes in error. The center sweep follows the density-based radius rule and adjusts the global-source budget with the center count, whereas the neighborhood sweep changes only .
The table reports mean test relative errors across all 2,871 fields using the final epoch-200 checkpoints, together with one-pass inference costs measured on an NVIDIA A100 80GB PCIe GPU. We follow the inference profiling protocol in the SuperWing appendix, reporting peak allocated GPU memory and median complete-field forward time.
| Centers | Peak memory (GiB) | Forward time (ms) | ||||
|---|---|---|---|---|---|---|
| 1,024 | 48 | 0.0390 | 0.0365 | 0.0834 | 0.545 | 34.08 |
| 2,048 | 48 | 0.0350 | 0.0342 | 0.0775 | 0.551 | 35.76 |
| 4,096 | 48 | 0.0338 | 0.0323 | 0.0743 | 0.565 | 34.82 |
| 8,192 | 12 | 0.0310 | 0.0284 | 0.0669 | 0.218 | 22.46 |
| 8,192 | 24 | 0.0303 | 0.0279 | 0.0664 | 0.342 | 27.00 |
| 8,192 | 48 | 0.0291 | 0.0273 | 0.0638 | 0.591 | 36.70 |
At 8,192 centers, reducing from 48 to 12 lowers peak memory by 63.1% and forward time by 38.8%, while increasing pressure error by 6.7%. With , the corresponding memory and time reductions are 42.1% and 26.4%, with a 4.2% increase in pressure error. Both reduced-neighborhood configurations retain pressure-prediction accuracy competitive with the strongest published baselines in Table 6. Increasing the center budget improves all three predicted quantities, while reducing centers alone provides smaller resource savings. These accuracy and resource results will be included in the revised manuscript.
The SuperWing sweeps hold the input count fixed. To examine input-resolution dependence separately, we have prepared a HiLiftAeroML study comparing fixed-center and scaling-center policies across different input resolutions, using the same independently sampled test queries for every configuration. Results from this separate study will be added upon completion.
References
William Peebles and Saining Xie. Scalable Diffusion Models with Transformers. ICCV, 2023.
Francisco Giral et al. AeroJEPA: Learning Semantic Latent Representations for Scalable 3D Aerodynamic Field Modeling. arXiv:2605.05586, 2026, version 1.
NVIDIA PhysicsNeMo. AeroJEPA SuperWing FLOP evaluator. Released implementation.
We thank the reviewer once again for their detailed feedback and the time devoted to our work. We would be pleased to clarify any remaining questions during the rebuttal phase.
Thank you for the additional relevant experiments and supplementary works. My questions have been partially addressed, and I will raise my score to 3.
We thank the reviewer for recognizing the value of our contribution. The newly completed HiLiftAeroML comparisons show that PLT outperforms the retrained AeroJEPA and Transolver-3 baselines at 4° and 12°, while achieving the lowest peak allocated GPU memory in our matched profiling. These results and the completed sampling-budget studies are presented in our comment, Summary of revisions and new results, and are detailed in the revised manuscript, with changes highlighted in blue.
Response to Reviewer ieNP - Part 1 of 2
We thank the reviewer for their careful review and for recognizing our method's practical value.
We agree that the originally cited results do not provide a direct benchmark comparison. We have therefore retrained AeroJEPA on the official 4∘ split with a comparable model size and aligned training settings, and evaluated both models on the same complete native surfaces using identical area-weighted metrics. PLT achieves lower mean errors across all four reported accuracy metrics. The results and protocol are provided in our response to hHD9-W1.
PLT’s contribution is a geometry-anchored local–global operator that combines quadrature-weighted local attention with sampled global communication while retaining spatially resolved center states for independent query decoding. As such, PLT really provides a novel approach for operator learning. In more detail:
Although PLT shares geometric grouping with PointNet++, neighborhood aggregation is performed through quadrature-weighted, content-dependent attention rather than pooling. Unlike the standard Perceiver-pooled representation in UPT, PLT retains physical center states for local processing and decoding. Unlike SMART’s dense geometry-to-latent cross-attention, PLT separates bounded local interactions from compact global communication. Erwin captures long-range dependencies through hierarchical coarsening, refinement, and cross-ball interactions. PLT instead combines overlapping radius-based 1×K cross-attention with an explicit sampled global mixing path. Independent query evaluation is shared with OFormer, UPT, and SMART and is not claimed as a standalone novelty.
Our comparisons also include multiscale architectures. These comprise FigConvUNet on SuperWing, U-FNO and U-NO on Elasticity and Plasticity, and HT-Net on Plasticity.
The separate ablations reported in our response to Dhxf-W1 demonstrate an additional accuracy benefit from quadrature weighting beyond the learned geometric bias on both Elasticity and SuperWing. These experiments isolate the effect of weighting at fixed sampling budgets, but do not separately evaluate local oversampling or cross-discretization.
Regarding center weights, as discussed in our response to Dhxf-Q1, we retain the original weights as relative geometric weights associated with the selected locations. A center’s expanding receptive field describes where its features gather information, rather than a physical cell assigned to that center. Since neighborhoods overlap, their areas cannot simply be assigned as distinct center-cell areas. Nevertheless, FPS changes the sampling distribution, and inherited weights are not a recomputed quadrature rule for the coarsened point set. We will clarify this distinction in Appendix C.
Our choice of adaLN-Zero follows Peebles and Xie (2023), who found that it outperformed cross-attention and conditioning through additional input tokens in diffusion transformers. We have now compared adaLN-Zero with direct concatenation of angle of attack and Mach number on SuperWing, keeping the backbone, sampling budgets, and training settings fixed. The table reports mean test relative L2 errors.
adaLN-Zero achieves lower errors for all three quantities, supporting its use in PLT. These results will be included in the revised manuscript.