- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces GEAR (Geometry-aware Alignment of Representations), an architecture-agnostic training framework for point-wise neural operators.
Critical strengths
-
Comprehensive Ablation Studies: The authors perform extensive ablation experiments isolating each core design choice.
-
Grounded Mathematical Formulations: The paper provides rigorous derivations in Appendix B supporting its core algorithmic steps.
Critical weaknesses
-
While the paper claims improved optimization step efficiency (7.4%–27.4% fewer steps), it omits absolute training wall-clock times (CPU+GPU) in the primary text. A neural operator training pipeline includes data loading, data device transfer, candidate neighborhood searching, local similarity calculations, KL divergence evaluation, and intermediate gradient projection. Reporting normalized ratios only in Appendix Table 5 (which shows shallow models actually take 28%–38% longer wall-clock time) obscures the true computational overhead. To make efficiency claims reliable, the authors should report full wall-clock execution profiles broken down by individual computational components. In particular this algorithm adds a huge computation outside of the vanilla model, the number reported seems little bit questionable.
-
The paper restricts its experimental comparisons to a fixed 200-epoch budget across all models. In engineering simulation, inference speed and accuracy is paramount, while offline training time is a secondary consideration. If vanilla Transolver can reach or exceed GEAR's accuracy by simply training for 400 or 600 epochs (allowing its unconstrained representations to naturally find optimal physical modes), the benefit of GEAR becomes questionable. An ablation study comparing the well-trained model of both methods is necessary to determine whether GEAR genuinely pushes the asymptotic accuracy limit.
-
The authors argue that vanilla Transolver fails to maintain geometric structure because its KL divergence with respect to increases over training epochs (Figure 5). However, is constructed using hand-designed heuristics (combining spatial Euclidean distance, boundary distance, and normal orientation vectors). For instance, in volume meshes in fluid mechanics / structure mechanics, Euclidean spatial proximity is often sufficient to capture local physics. Forcing intermediate states to align with arbitrarily weighted boundary or orientation metrics () imposes an artificial prior. An increasing KL divergence in vanilla models does not necessarily imply that the latent representations are "degrading" or "bad".
-
The paper lacks a sensitivity analysis or clear practitioner guidelines on how to tune these parameters for a novel geometry or PDE dataset. Without a standardized tuning protocol, applying GEAR to new engineering domains requires extensive trial-and-error hyperparameter search, diminishing its practical usability.
Questions for authors
Please see my Critical Weaknesses for questions.