- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper focuses on the cross-resolution transfer of neural operators (NOs), specifically on whether the performance of NOs on grids other than the training resolution can be predicted. If so, the cost of labeled validation at the target resolution can be saved. The main insight of the paper is to make this prediction by probing the frequency-domain response of NOs at low cost, and the paper formalizes a series of specific parameters, thresholds, and operations to make this prediction operational and accurate. The main result is that, when the probe does not abstain, the paper accurately predicts the cross-resolution generalization ability of NOs, and it uses a second grid to identify models anchored to the training grid.
Critical strengths
-
Predicting in advance whether NOs generalize across resolutions is a meaningful problem, because it can save part of the cost. I therefore fully acknowledge the motivation of the paper.
-
The paper validates its own claims from multiple angles and with good completeness: sensitivity to regimes, models, parameters, etc. is all examined. I therefore acknowledge the completeness and transparency of the paper's experiments.
Critical weaknesses
-
The core idea of the paper is not novel, and the additional formalization is overly empirical and, in practice, not particularly accurate. Although few works directly target predicting, before deployment, whether NOs generalize after a change of resolution, probing the frequency-domain response of NOs in advance and using it to explain their generalization at higher resolutions has already been discussed or used in prior literature [1,2]. Compared with these existing works, the only additional contribution of the paper appears to be turning the qualitative inference of "judging generalization from band-wise responses" into operational quantitative thresholds and procedures. Therefore, I do not think the paper offers me any new insight. What is novel in the paper is the formalization and operationalization of the above idea. However, many parameters and thresholds are chosen rather empirically, which makes their generalizability in practice questionable: the safety threshold defines both the ground-truth labels and the decisions, and neither the stationarity tolerance nor the abstention margin of (which the protocol states was selected on development seeds) is derived, among other choices. Moreover, concordances such as 0.99 are computed only on the ~37% of model pairs where the probe does not abstain; counting abstentions as 0.5, it drops to about 0.68. Therefore, the paper's formalization both lacks justification and is not accurate.
-
More seriously, the so-called newly designed probe is equivalent in meaning to validation on held-out samples from the deployment distribution at the training resolution. In the supplementary code, the probes and the deployment evaluation data are generated by the same random-field generator with the same set of spectral parameters, and are labeled by the same reference solver; the only differences are the random seed and the fact that is capped at . Therefore, is simply the band-wise error of a small set of held-out deployment-distribution samples on the training grid, while the prediction target is the band-wise error of the same distribution on other grids; for stationary operators, the two are approximately equal by definition. Furthermore, I computed the simplest baseline using the authors' own records: selecting directly by the band-wise error of held-out data on the training grid performs on par with or better than the probe. Therefore, the paper's selection results cannot show that the probe provides any information beyond held-out validation at the training resolution, which directly undermines the core contribution of the paper.
[1] Wang et al. Breaking Scale Anchoring: Frequency Representation Learning for Accurate High-Resolution Inference from Low-Resolution Training. ICLR 2026.
[2] Sakarvadia et al. The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operators. ICLR 2026.
Questions for authors
-
Compared with the approach in [1,2] of qualitatively judging generalization from band-wise responses, what does the paper's quantitative procedure reveal that qualitative analysis cannot?
-
Could the authors explain what essential difference exists between the probes and held-out samples from the deployment distribution, other than the random seed? And if they do differ, why is the accuracy of the former comparable to that of the latter?