- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper points out that in-distribution accuracy does not support the accurate transport behavior. Also, it tries to demonstrate and explain this gap. In addition to that, the authors shows some experimental evidence to clarify their claim.
Critical strengths
(S1) The paper addresses an important problem such as the gap between the prediction accuracy and physical fidelity. Also, the starting point of the discussion is understandable and good.
(S2) As authors mentioned, this topic might be connected to the OOD behavior of the learning-based simulator. In this sense, the direction of the research question makes sense.
Critical weaknesses
(W1) The most important point is that the paper is not well-organized at all. Therefore, for me, it is difficult to catch the motivation, contribution, and importance of this work. Also, the visualization by each figure is not effectively used. In addition, some part of figures are broke, for example, the numbers in Figure 1 (c) are overlapped by plots.
(W2) As I mentioned in the strengths, the starting point of the discussion is understandable. However, the importance or naturally of the direction of discussion is not clearly written. Also, the merits or soundness of the analysis for their motivation is not well validated.
(W3) The experimental and analytical evidence is limited. I cannot catch the generality of the discussion, which is related to (W1).
(W4) The discussion is limited to advection, which is somehow minor.
Overall, author should comprehensively reconsider the organization and presentation of concept of this work to make it easy to understand for broader readers.
Questions for authors
(Q1) Please explain again the concept and main contribution of this work in language that even non-experts can understand.
(Q2) How general is the method? For example, do you think that this type of discussion can be applied for non advection physics, and how?
(Q3) The figures are created by AI? Personally, it is OK, but it is better to arrange each component in tidy way for clarify the meaning of the figures.