- Rating
- 3(+2)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces Mesh-Native Convolutions (MNC), a tokenizer that enables models trained on grid data to process arbitrary meshes. After describing the MNC layers and briefly comparing them with GCN, they apply the method to Overtone. The model(s), originally trained on grid data, outperform mesh-native models such as GINO or LNO, even with zero-shot transfer. Similarly, combining MNC with Walrus, they model the cylinder flow dataset, a system that requires irregular meshes and that Walrus has never seen.
Critical strengths
Their work enables models trained on grid data to process arbitrary meshes without (or with very little) further training.
Critical weaknesses
I doubt experiments I and II are fair or useful. Except for LNO, the benchmark models are significantly smaller than the models MNC is built on. Even if size were similar, it's unclear whether MNC offers any benefit (maybe the model is just better), and why should it? If MNC enables models trained on grid data to process arbitrary meshes without a performance drop, I'd call it a success. If you show this (maybe by combining MNC with small models in prediction tasks), I'd be happy to increase my rating.
Minor criticism: given how MNC is defined, the exact consistency with CNN encoders seems more a valuable sanity check than a separate contribution.
Questions for authors
-
Related to the weakness, have you tried coupling overtone or other models to point-cloud encoders?
-
Out of curiosity, as I don't expect you to do it within the rebuttal time, have you tried your approach on 3D data? The extension seems pretty natural and would strengthen the value of your method.
3 comments
Thank you for the detailed reply and additional work. I appreciate the new experiments on different meshes and the preview of the 3D results. I would also like to thank Reviewer S8Rj for asking about direct alternatives, and the authors for carrying out that comparison. It is a valuable addition.
As my concerns have been addressed, I raise my score to 3.
Two suggestions that wouldn't change the rating:
- The experiments in Appendix F deserve a place in the main text. I understand that space is limited, but at least Table 11 would be worth adding.
- With alternatives in the main paper, it would make sense to mention them in the discussion. The strong performance of interpolation is worth noting.
We thank the reviewer for their positive response and for taking the time to carefully consider our rebuttal and additional experiments. We are very pleased that these have addressed their concerns, and greatly appreciate their constructive feedback.
Score update: We are very grateful for the reviewer's decision to increase their rating to 3 (weak acceptance). We noticed, however, that the official review still displays the original rating of 1 (clear rejection), so we wondered whether the change might not have been saved. Would the reviewer mind checking this once more? We apologise for the additional request and very much appreciate their help (scores can be updated by editing the official review on OpenReview).
Suggestions: We also thank the reviewer for their two additional suggestions, both of which we have incorporated into the revised manuscript:
-
Mesh transfer experiments in the main text: We have now included a concise presentation of the mesh transfer experiments at the end of Sec. 4.1, with a discussion pointing to the more extensive results in Appendix F, including the FNO experiments.
-
Discussion of alternative tokeniser performance: We have expanded the discussion of Experiment 4 (Sec. 4.4) to acknowledge the strong performance of interpolation and highlight the regimes in which MNC outperforms interpolation and the other tested alternatives.
Finally, our 3D experiments are now included in Appendix E.5, together with representative figures, demonstrating that MNC also retains its strong performance in the 3D setting.
Once again we thank the reviewer for their time and consideration.
We thank the reviewer for their detailed reading of our work and we particularly appreciate the reviewer's concrete criterion for reconsidering their assessment: whether MNC can transfer grid-trained models to irregular meshes without a substantial loss of accuracy, including for smaller models. We have now tested precisely this, and added further comparisons and clarifications that directly respond to the concerns and questions raised by the reviewer.
The overall conclusion is that MNC moves grid-trained models onto meshes with very little loss of accuracy at every model size from 2M to 26M parameters, is more accurate zero-shot than a distilled point-cloud encoder, and extends to 3D. We believe this addresses the reviewer's concerns, and would thus warmly welcome an increase in their score. If the reviewer has remaining concerns we would invite them to raise those points explicitly for discussion. Please find a point-by-point reply below. Changes are also highlighted in red in the revised pdf.
Response to critical weaknesses:
(a) Mesh transfer without performance drop: This property was already tested and demonstrated in experiment 2, but we have included a more extensive evaluation in a new experiment in Appendix F to confirm the favourable transfer property. Here we train Overtone at three sizes on the TRL2D grid and evaluate it zero-shot on five meshes through MNC. Over ten-step rollouts the error stays within 7% of the grid on most meshes, at every size; and even on the highly graded mesh the error remains far lower than random weights. VRMSE (×10−2):
The same holds with an FNO processor behind the tokeniser, so the transfer is not a property of one model but rather the encoder architecture:
(b) Exact consistency as a contribution: We agree, and have recast it as a design feature rather than a separate contribution (Sec. 1 and before Proposition 1). However, we politely disagree that it is only a sanity check: MNC was built around this property, and a mesh tokeniser need not have it. Point-cloud encoders, for example, have no grid counterpart to load weights from, so their tokeniser must be trained or distilled against the processor. With MNC the pretrained weights are loaded directly, and the saving is measurable: in Figure 6 the retrofit reaches its plateau within ten epochs of fine-tuning, against about a hundred from scratch.
Answers to questions:
A targeted comparison with the same Walrus checkpoint is the new Experiment 4 (Sec. 4.4).
Conv3dtransfer in the same way. We are evaluating the architecture on the 3D MHD dataset of the Well; the runs (close to 10,000 USD of compute so far) are still ongoing. Interim results, from a 643 grid to a 261k-node tetrahedral mesh, show the same picture as in 2D. Next-step / 10-step VRMSE (×10−2):These come from early checkpoints of the grid pretraining for a single seed; we will add the final results to the revised manuscript as they arrive. We thank the reviewer for this excellent suggestion.