- Rating
- 1
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper claims to establish a "realization-cost principle" and it characterizes consistent recovery through target approximations with vanishing penalized parameter cost. Also, the authors give implementation of this principle based on Wick polynomial. They also claim to demonstrator the mechanism using cubic responses of two-dimensional Gaussian free fields.
Critical strengths
(S1) The starting point of discussion that neural operators should recover the same physical interaction as input resolution increases is good.
(S2) Related to (S1), when we consider neural simulator such as neural operators for physical phenomena, preserving the underlying physics is significant problem. Thus, the motivation of this paper is understandable, as far as I understand correctly.
Critical weaknesses
(W1) First of all, at least for me, this paper is not well-organized. It is quite difficult for me to understand correctly motivation, contribution, and main claim. As a result, it is almost impossible for me to judge the true contribution of this paper and that this is due to the quality of this paper or my understanding.
(W2) The discussion on the related work and the position of this work is quite limited. As a consequence, it will make difficult readers catch motivation and contribution of this paper.
(W3) The quality of the figures is not so good. To be honest, I cannot understand the meaning of the figures (for example Figure 1). It is better for the authors to reconsider the figures that would be easy to understand for non-expert readers.
Overall, I personally feel like that this paper dose not meet the standards of ICLR paper.
Questions for authors
(Q1) Please explain and clarify the motivation and contribution of this paper. I would like to know the main concept and results of this paper intuitively since my understanding may be not quite well.
(Q2) Please reconsider the organization and each component of each figures which can be understood for broad ML readers. Perhaps, the figures are created by AI?
(Q3) To clarify the background of this work, please discuss the related work more throughly and carefully.
2 comments
Thank you for your response. I have read the rebuttal and quickly gone through the revisions. Even now, it is hard to change my decision. The quality of the manuscript is not good enough to accept as the ICLR paper. Also, importantly, I believe that the paper with significant revisions is better to get another review cycle.
Dear Reviewer,
Thank you for your review. First of all, we apologize for the overall presentation of our paper. It was not well written and not very clear. We rewrote it entirely (including the figures) without using AI (except for a few typo fixes, cf. rebuttal to reviewer nUj2) and added a clear AI statement. Now the paper should be easier to understand for non-expert readers. We therefore ask you to reconsider our paper, and we hope that it now meets the ICLR quality bar.
We added back the discussion about related work in the first paragraph. And we enhanced the conclusion and limitations part (last paragraph of the main text). We also made the figures much clearer and easier to understand.
For your first question, we aim to repply to this: As the input gets more finely resolved, does the network keep learning the same thing?
Our findings: Not always, the weights needed to express the right answer can grow in magnitude with the resolution, and weight decay will then penalize large weights. So training may settle on a different answer, even when the weight decay is quite weak. In other words, what the network can express is not the same as what it will learn. We make this precise, and give a fix.
For your third question:
We agree so to clarify the background of this work, to clarify the background of this work, we discuss related literature in more depth. Appendix G contains a complete related-work discussion, and we provide a compact pointer to it in the Introduction. Our contribution centers on the realization cost of an interaction as resolution grows.
We hope we answered to you main concerns about the paper's format. We kindly ask you to reconsider the paper if you think it cross the ICLR bar.