- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper focuses on zero-shot compositional generalization for neural PDE solvers, where different material types are seen separately during training but appear together during testing. The authors propose CCR-MIG, which modifies Transolver by introducing material-guided latent-state routing with a bounded mixing mechanism and a conflict-aware gate. Experiments on 2D elasticity and thermal conduction show improved average accuracy compared with the original Transolver and a feature-matched baseline.
Critical strengths
-
The paper considers an interesting and practically useful generalization problem for heterogeneous PDEs. I think directly using material information to guide latent-state routing, instead of only adding it to input features, is a reasonable idea.
-
The proposed method is relatively simple and can be easily added to the existing Transolver framework. The results on both PDE problems are encouraging, and the ablation studies provide some evidence for the effectiveness of the proposed routing design.
Critical weaknesses
-
I think the technical novelty is somewhat limited. The main idea is essentially to combine the original routing with material-guided routing using a bounded weighting factor. The theoretical bound itself is also quite straightforward. In addition, the benefit of the conflict-aware gate is not very clear, especially for the thermal conduction problem.
-
The experiments are still somewhat limited in terms of problem complexity and generalization. Both benchmarks are based on relatively simple 2D linear, steady PDE problems, with mostly circular inclusions. It would be more convincing to see results on more complex geometries, material combinations, or other PDE systems. Also, although the average errors are improved, the differences are not statistically significant across the six random seeds.
Questions for authors
-
Would simpler material-guided routing or gating designs achieve similar results? How important is the use of Gaussian-shaped routing distributions?
-
The conflict-aware gate improves the elasticity results but has little benefit for thermal conduction. Could the authors explain this difference?
-
Could the authors provide more quantitative results on different inclusion shapes, mesh resolutions, or more complex material combinations? This would help better understand the generalization ability of the method.
-
Since the mixed-composition development set was used to select the routing design, could the authors further clarify how this affects the zero-shot generalization setting?
2 comments
Response to Reviewer bhaw
Response to Reviewer bhaw (2/2)
Could the authors provide more quantitative results on different inclusion shapes, mesh resolutions, or more complex material combinations? This would help better understand the generalization ability of the method.
Thank you for this suggestion. For material combinations, the test sets contain SH, SSH and SHH plates. For mesh, the benchmarks use different meshes, including a coarser, non-conforming mesh on the perforated plate (1,585 nodes). When 30% of the input nodes are removed, the dominant slice is unchanged for 99.5% of the retained nodes and the prediction changes by 0.25% (Figure 8, p. 27, l. 1404); this is an input-sensitivity test and not a mesh-convergence study. For inclusion shapes, we tested the seed-123 models, trained on circular inclusions only, on 180 new plates with ellipse, kidney and blob inclusions (p. 37, l. 1972, Figure 13). CCR-MIG reaches 0.0261 against 0.0330 for Transolver (21.0% lower, 153 of 180 plates), with reductions of 17.9% for ellipses, 20.0% for kidney shapes and 25.1% for blobs. This test uses one seed, and multi-seed training on other shapes remains future work.
Since the mixed-composition development set was used to select the routing design, could the authors further clarify how this affects the zero-shot generalization setting?
We thank the Reviewer for raising this point. No mixed sample is used for training or for checkpoint selection, which is based only on the non-mixed validation set. The 200-sample mixed set served as the development set during method design, and no result reported in the paper is computed on it. The 400-sample holdout was generated with an independent seed only after the routing design had been fixed on that development set, and it was not used for training, checkpoint selection, hyperparameter tuning or design selection (p. 7, l. 370; Figure 3, p. 7, l. 333). For example, we retain the conflict-suppression strength λ_C = 0.55 even though removing suppression lowers the holdout error by 5.8% (p. 37, l. 1996). The model is therefore zero-shot with respect to its training data and its weights, while the development set did inform the design choices, which is why it is kept separate from the reported evaluation.
Response to Reviewer bhaw
Response to Reviewer bhaw (1/2)
We thank the Reviewer for this assessment. We agree that the bound is simple, and we present it as a design guarantee and not as a deep result. The main contribution is the finding, from a controlled comparison with the same constituent encoding, that where constituent information enters Physics-Attention matters. Conditioning the slice assignment instead of the node features lowers the error by 8.7–18.6% in six of seven benchmarks (p. 8, l. 417). The revised routing also has a precise form: each proposal is a Gaussian kernel over the learned slice embeddings, which makes it equivariant to slice relabelling (Proposition 1, p. 7, l. 343). The gate is addressed in our response to the second question below.
Thank you for this suggestion. The revision adds waisted and perforated geometries, two- and three-inclusion test compositions, and two nonlinear constituent laws. With eight seeds and the corrected holdout, the improvements over Transolver and Gaussian-bank routing are significant after Holm correction in all seven benchmarks (Table 1, p. 9, l. 432).
We thank the Reviewer for this question, which led to the main change in the paper. The simpler submitted design, one fixed Gaussian band over the slice index per category, performs substantially worse: replacing it with constituent proposals lowers the error by 40–55% (8/8 seeds, Holm p = 0.023; Table 1 and Table 3, p. 23, l. 1225). Where the Gaussian is defined matters: over arbitrary slice indices it ignores the learned slice geometry, whereas over the learned slice embeddings it does not. For gating, removing conflict suppression does not hurt accuracy (Appendix M, p. 37, l. 1996). To answer the second question directly, we replaced the Gaussian-form proposal by a saturating tanh kernel that keeps all inputs, parameters and training settings (p. 24, l. 1264). On rectangular elasticity (mixed-400, eight seeds), this variant reaches 0.0246 compared with 0.0232 for CCR-MIG; CCR-MIG wins four of eight seeds, and the difference is not significant (p = 0.39). The variant is still 25% more accurate than Transolver (7/8 seeds). The gain therefore does not depend on the exact Gaussian form; in this experiment the Gaussian form mainly reduces the spread across seeds (SD 0.0012 versus 0.0037). What matters more is what the kernel is defined over: the learned slice embeddings rather than the slice indices.
We thank the Reviewer for pointing this out. With the revised model, conflict suppression does not help in either problem. Removing it at test time, with identical weights, lowers the error by 5.8% for elasticity and by 10.3% for thermal conduction, in 8 of 8 seeds for both (p = 0.0078 each; p. 37, l. 1996, Table 16). Because the conflict term is zero during training, its strength receives no gradient, and the factor acts only as a fixed test-time rule that weakens the learned routing between soft and hard inclusions (Figure 15). The gains of CCR-MIG therefore come from the constituent proposals, and the paper now states this for both problems.