- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper is junk and makes no meaningful contribution.
Critical strengths
None
Critical weaknesses
- The paper does not have a clear explanation of the research problem it aims to address.
- The paper is not written in a way that human can understand.
Questions for authors
Have the authors read the paper before submitting it?
3 comments
The introduction has only one sentence that vaguely states the goal of the paper: “Throughout, we study recovery of regimes deliberately excluded from training rather than interpolation across parameter values.” It is not clear what “recovery of regimes” means.
The introduction begins by discussing “predicting events that are unseen in the training set” and calls it a “less common” ML application. This is not true. There are a lot of papers (including some of those cited in section 2) in the scientific ML literature that address generalization to unseen data.
Generalization in neural emulators is a very broad topic. The literature addresses generalization across time, space, initial conditions, boundary conditions, system parameters, and other dimensions. To make a clear and meaningful contribution, the authors need to specify:
- Which types of generalization does this paper address?
- What metric is used to define success/failure?
Without a clear problem definition, the paper jumps into model architecture and experimental settings too quickly, making it read like a technical report. The conclusions drawn from the experiments, particularly those on lines 439, 443, 461, and 467, do not offer a useful takeaway. What can the audience learn from these conclusions?
The authors should clearly identify the central contribution and design experiments around it: is it a new method, a new explanation, or a new insight? That being said, these concerns are not simply writing problems that can be fixed quickly. The work requires substantial improvement in conceptualization and experimental design. I maintain my original score.
We thank the reviewer for these specific comments. The paper addresses one type of generalisation: recovering dynamical regimes that are deliberately excluded from the training data, as opposed to interpolating between parameter values or initial conditions seen in training. Each experiment defines the excluded regime explicitly (laminar states beyond a bifurcation for Kolmogorov flow, kink transitions and larger domains for Kuramoto–Sivashinsky, and coalescence, nucleation and four-jet states for the beta-plane), and success is judged against DNS of the same regime. We agree that this definition, and the criteria for success and failure, should be stated more prominently in the introduction, and that the central takeaway should be drawn out more explicitly. We will take these points on board in the revised manuscript.
We thank the reviewer for their time. We would welcome specific points on which the research question or the presentation was unclear, and would be glad to clarify them. A summary of the revisions made in response to the other reviews is posted above.