- Rating
- 4
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The main idea that the paper introduces is a Neural Operator based on a CBS fixed-point loss which outputs the solution of a Helmholtz equation for given velocity field, source and frequency.
By doing that, no labeled data is needed for training. The loss function computes the discrepancy between the predicted wavefield and a number of CBS iterations of it.
As an application, the authors use the trained model for velocity field inversion.
Critical strengths
(1) The essencial idea of the paper is quite interesting: using CBS fixed-point updates to enable neural operator training without labeled data. This is an elegant way to incorporate physical information in the training process.
(2) The comparison with baseline methods is solid. The authors compare their method with a good set of consolidated existing architectures (PINN, PINO, among others), obtaining good results.
(3) Besides the main idea explained in the Paper Summary above, the proposed architecture has some very interesting features, such as frequency-partitioned experts (this may be particularly important for modeling wave propagation with neural networks), and a mechanism to avoid missing reflections in the inverse problem. The strategies employed by the authors have not just an emperical/experimental justification, but they specifically address some well-known difficulties in modeling wave propagation.
Critical weaknesses
None
Questions for authors
In page 4, the paragraph "Physics-Inspired Axial-AFNO backbone seems to be incomplete. Possibly, a period is missing after Fig. 3? Anyway, I think this paragraph is not very clearly written. Can you check, please?
In page 21, paragraph "Inversion Hyperparameters", you say that you used Adam with a learning rate of 10. Is this correct? It seems unconventionally high.
Do you plan to make your code available? I honestly do not think that just presenting the experimental setup is enough for reproducibility.
I miss some information regarding training time. May you add some discussion about that?
The number of CBS iterations seems to be a very important hyperparameter of your model, but it seems to be just briefly discussed in the ablation section. Maybe you could add more discussion about that? (this is just a suggestion).
3 comments
Thank you very much for your detailed and clarifying answer!
Appreciation for Your Feedback
Thank you for your positive feedback and constructive suggestions! Wishing you all the best!
Response to Reviewer qtq2
Thank you very much for your positive feedback! We address your questions and summarize the corresponding revisions below.
Re: Great catch! We have merged the backbone introduction and its explanation into one continuous paragraph in Section 2.4 (p. 4), correcting the interrupted paragraph layout and punctuation.
Re: Good question! In our FWI implementation, Adam directly optimizes velocity in m/s, so the learning rate of 10 is interpreted on this physical scale. Actual nodewise updates depend on the adaptive moment estimates and subsequent velocity clipping; this does not mean a fixed 10 m/s change at every node. Yang et al. [1] also use Adam for velocity inversion, with a learning rate of 20. We have clarified the velocity units and learning-rate interpretation in Appendix D.2 (p. 24).
Re: Thank you! We will publicly release our code upon acceptance to support reproduction and further research.
We have added the code-release commitment to the Reproducibility statement (p. 11).
Re: Great suggestion! Each of the four frequency experts receives 20,000 optimizer updates (80,000 in total). Profiling on an otherwise idle RTX 4090 gives 1.4416 s per self-supervised update at an effective batch size of 50 and CBS K=5, yielding an estimated total of 32.04 GPU-hours for network-update computation. Data preparation, transfer, validation, and checkpoint saving fall outside this timing scope. Using the 50-update inversion times of 60 s for CBNO and 720 s for CBS in Table 2, this upfront computation corresponds to roughly 175 inversions worth of runtime savings (32.04 × 3,600 / (720 − 60)). We have clarified the per-expert update budget, timing scope, and training–inversion trade-off in Section 2.7 and Appendix C.4.
Re: Good question! K controls the number of CBS corrections used to construct the training loss. We assess its effects on direct wavefield optimization and network prediction accuracy to explain our choice of K=5.
(1) Direct wavefield optimization. We analyze multi-frequency Marmousi runs, directly optimizing the real and imaginary components of U without a neural network, while keeping velocity, sources, and frequencies fixed. We use a 256×256 physical grid with 25 m spacing, two interior sources, and frequencies sampled within 1–30 Hz at Δf=1/3 Hz. Starting from zero, U undergoes one million AdamW updates (learning rate 10−4), reaching stable error plateaus. Reference fields are computed separately using CBS with a relative-update tolerance of 10−5 for evaluation. The table reports global relative L2 error over the entire batch, including PML, and the updates needed to first reach <0.1% error.
Larger K reduces the final error and the updates needed to reach the threshold, with diminishing gains; K=5 achieves approximately 0.05% wavefield error in this direct optimization setting.
(2) Network accuracy. Table 3(a) shows that increasing K from 1 to 5 reduces network prediction error by 29.5%, whereas increasing it from 5 to 10 yields only a further 0.52% reduction:
These results support K=5 as a practical default capturing most of the observed network accuracy gains. K can be adjusted based on validation accuracy, while inference requires only one network forward pass. We have added these conditions and results in Appendix B.3 (pp. 17–19), Table 5 (p. 19), with the network-accuracy comparison in Section 3.4, Table 3(a).
References
[1] Yang, S., Alkhalifah, T., Ren, Y., Liu, B., Li, Y., & Jiang, P. (2023). Well-Log Information-Assisted High-Resolution Waveform Inversion Based on Deep Learning. IEEE Geoscience and Remote Sensing Letters, 20, 1–5. DOI: 10.1109/LGRS.2023.3234211.
Remark: Thank you again for your encouraging feedback and helpful suggestions! We hope the revisions make the presentation and experimental settings clearer. Wishing you a pleasant week!