- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Executable Neural Operators (ENO), which replaces global parameter sharing with bipartite tokenization, dynamic routing over localized graph-neural mechanisms, and Targeted Mechanism Revision (TMR) enforcing a gradient firewall during online adaptation. Theoretically, the authors provide conditional guarantees on Sobolev approximation, finite covering of local Green's operators, architecture-conditioned error isolation, and causal identifiability. Experiments on 3D magnetotelluric inversion show that ENO achieves accuracy parity with FNO on zero-shot OOD generalization while substantially reducing physics violations.
Critical strengths
-
The paper addresses a well-motivated problem: updating a model to accommodate a localized change can disrupt predictions on the original background input. The proposed “gradient firewall” tackles this through explicit restrictions on parameter updates, offering a concrete architectural approach to reducing interference.
-
The adaptation experiments include useful controls. Table 7 compares update policies from the same checkpoint, including routed TMR, rotated expert selection, updates to all mechanisms, and full-parameter updates. These comparisons help isolate the effect of selecting which parameters to adapt. Background prediction drift is also a valuable metric because it directly tests the model’s ability to retain its previous behavior.
Critical weaknesses
-
The evaluation remains small in scale. The main results use an (8^3) grid, 48 training samples, and ten online adaptation steps. The (12^3) experiments in the appendix provide an additional check, but both settings are still far smaller than realistic field-scale geophysical problems. It remains unclear whether the accuracy, computational efficiency, and retention benefits persist at substantially larger scales.
-
The zero-shot results do not demonstrate an accuracy advantage over FNO. ENO has a slightly higher mean NMSE of 0.471, compared with 0.4623 for FNO. Given the reported uncertainty, these results are better interpreted as comparable accuracy. The case for ENO therefore rests mainly on its adaptation and retention benefits, rather than improved zero-shot prediction.
Questions for authors
-
How should the mechanism-library size (K) be chosen as the coefficient class (\mathcal{A}_R) becomes more complex, for example through additional interfaces or larger conductivity contrasts? Is there a computable lower bound or a practical selection criterion for (K) at a given approximation tolerance, rather than choosing it through validation alone?
-
How does TMR handle cases where the same expert is used in both the anomaly and background regions? Updating that expert could affect background predictions through shared parameters or subsequent message passing. Could the authors clarify how the evaluated implementation enforces the parameter-ownership and dependency conditions required for isolation, and what accounts for the remaining nonzero background drift?
Most of my concerns have been addressed. That said, I am willing to raise my score to 3, though I would not object to the paper being rejected.