- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a Transformer that corrects a Gauss–Newton–TV reconstruction using intermediate medium estimates and adjoint residual fields. On 144 synthetic test trajectories, its default model reduces relative medium error from 13.96% to 9.26%, with additional comparisons covering neural baselines, input ablations, noise, grid resolution, and runtime.
Critical strengths
-
Substantial reconstruction gains with supporting physical validation. Transformer–Local improves medium error over GN–TV3 and the complete-trajectory U-Net baseline: 9.262% versus 13.964% and 10.268%, respectively. Clean unobserved-direction scattering error also improves from 3.891% to 2.416% over GN–TV3, supporting meaningful recovery.
-
Useful controls and practical cost reporting. Retrained input ablations, complete-input concatenation baselines, and full deployment timing strengthen the evaluation. The default model adds a moderate runtime cost over GN–TV3: 10.178 versus 8.593 seconds.
Critical weaknesses
-
The central benefit of solver history is small and uncertain. Repeating only the final medium–adjoint token nearly matches the complete trajectory: 9.386% versus 9.262% error for Transformer–Local; Transformer–FNO actually favors repetition (Table 2). Appendix G shows that repetition also eliminates attention’s influence, leaving only 38,073 effective parameters versus 152,841. These results suggest that most gains come from final-state correction and adjoint information. With one training seed and no numerical bootstrap intervals reported, the incremental contribution of history—the paper’s central premise—is not established convincingly.
-
Grid-transfer evidence is difficult to interpret reproducibly. Appendix B identifies the grid dependence of Euclidean adjoints, but Appendix H omits explicit cross-grid feature scaling, regularization scaling, and common-grid resampling details. Moreover, at 64^2 Local worsens visible scattering error from 6.495% to 9.101% relative to GN–TV3 . Although acknowledged, this limits the robustness conclusion.
Questions for authors
-
Assessment-critical validation: Does the history advantage persist against a model of comparable capacity using only the final medium and adjoints, across multiple training seeds? Please provide the numerical paired confidence intervals described in Section 5.1.
-
Clarification: How are adjoint inputs, solver regularization, and medium resampling handled across grids? These details would materially affect interpretation of the transfer results.
8 comments
Response (Part 2/2)
-
Cross-grid transfer, regularization scaling, resampling, and scattering behavior (W2 & Clarification)
-
Rigorously scaling regularization parameters and applying area-overlap resampling ensure mathematical consistency and reproducibility across different grid resolutions. We summarize the exact scaling rules and resampling procedures below and have added them explicitly to Appendix H to ensure full reproducibility. Let denote the number of grid cells per side, with serving as the reference grid. The regularization and damping coefficients, together with the adjoint inputs, follow the scaling laws:
\alpha_N = \alpha_{96}(96/N)^2,\ \mu_N = \mu_{96}(96/N)^2,\ \lambda_N = \lambda_{96}(96/N),\ \widetilde a_N = (N/96)^2a_N \end{xalignat*}$$ where $\alpha$, $\mu$, and $\lambda$ denote the Born regularization, Gauss–Newton damping, and TV coefficients, respectively. After scaling, the cached adjoint fields $\widetilde{a}_N$ are normalized by the fixed training RMS values. | Native grid size $N$ | Born/GN coefficient multiplier | TV coefficient multiplier | Adjoint multiplier before normalization | | :------------------: | :----------------------------: | :-----------------------: | :-------------------------------------: | | $64$ | $2.25$ | $1.5$ | $4/9$ | | $96$ | $1$ | $1$ | $1$ | | $128$ | $0.5625$ | $0.75$ | $16/9$ | -
Area-overlap averaging projection maps native predictions back to the reference grid for fair evaluation. The neural network operates directly on the native grid with frozen weights. Ground truth media are constructed from the same analytic medium by averaging values at subcells within each cell. For common-grid medium-error evaluation, predictions on are resampled onto the reference grid using cell-overlap area fractions as weights (area-overlap averaging projection). Scattering data are computed directly on the native grid and compared against high-resolution reference measurements.
-
Discrepancy between medium error and scattering consistency stems from objective divergence and forward-operator sensitivity. At , Transformer-Local still improves native-grid medium reconstruction over GN–TV3 (12.213% vs. 13.048% in Appendix Table 7) because the network is supervised to minimize medium-field error rather than data misfit. However, because the forward wave operator exhibits heightened sensitivity to specific spatial error modes—and zero-shot evaluation across grids introduces layerwise discretization mismatch [1] and frequency shifts [2]—improved medium accuracy does not automatically translate into lower scattering misfit on coarser grids. We have expanded Section 5.4 and Appendix H to clarify this distinction.
-
References:
-
[1] Wenhan Gao, Ruichen Xu, Yuefan Deng, Yi Liu. Discretization-invariance? On the Discretization Mismatch Errors in Neural Operators. In International Conference on Learning Representations (ICLR), 2025.
-
[2] Mansi Sakarvadia et al. The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operators. In International Conference on Learning Representations (ICLR), 2026.
Follow-up on Our Response and Additional Results
Dear Reviewer,
Thank you again for your time and thoughtful feedback. We would like to follow up on our response and ask whether you have any remaining questions or concerns. We welcome further discussion and would be glad to provide any additional clarification.
If our response and additional results have addressed your concerns, we would be grateful if you could consider a more favorable score in light of this evidence.
Thank you for your consideration.
Response (Part 1/2)
We sincerely thank you for those insightful comments. Many of your comments will help us produce a more readable and self-contained version of the paper. Below, we address each of your specific concerns in turn.
Core history benefit, effective capacity, and multi-seed validation (W1 & Q1)
Controlled capacity-matched comparisons and 20-seed evaluations confirm that the performance advantages of solver trajectories are statistically significant and robust. To address concerns regarding the margin between complete trajectories and repeated final states, effective parameter differences, and single-seed variance, we conducted supplementary evaluations across 20 independent random seeds. In addition to comparing Complete (A1) against Repeated last, we also evaluated a capacity-matched single-state baseline (B1, widening the value projection on the Local scaffold using only q3 to reach 152,170 effective parameters vs. 152,841 for A1).
For each training seed, we compute the mean paired error difference on the fixed test set. Across 20 seeds, the 95% confidence interval is
\bar{\Delta}\pm t_{19,\,0.975}\frac{s_\Delta}{\sqrt{20}} \end{xalignat*}$$ where $\bar{\Delta}$ and $s_\Delta$ are the sample mean and standard deviation of the seed-wise paired differences. All 95% paired $t$ confidence intervals strictly exclude zero under both 100-epoch and 200-epoch budgets, proving that the advantage of incorporating full solver history is statistically significant and not an artifact of random seed selection or parameter count.Historical trajectory information yields substantial reconstruction improvements when paired with our trajectory-aware attention mechanism. While Transformer-FNO slightly favors repetition (Table 2), both Transformer-Local and Transformer-UNet consistently benefit from complete solver histories. Furthermore, comparing trajectory-fed models against single-frame or direct-concatenation baselines (Table 1) demonstrates that leveraging intermediate iterates substantially lowers reconstruction error when paired with an architecture capable of modeling iteration dynamics (e.g., reducing full-field error from 10.268% in concatenated vanilla U-Net and 12.299% in concatenated vanilla FNO down to 9.262% in Transformer-Local).