- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
In the paper "All Roads Lead to Markov Kernel Networks: A Representation Theorem for Discretization-Stable Learning," the authors establish a representation theorem showing that uniformly discretization-stable operators can be represented exactly as stable Markov kernel networks. They further develop a variational formulation that connects several existing neural operator architectures and provides sufficient conditions for discretization stability.
The paper presents an interesting theoretical result addressing a relevant problem in operator learning. While I have not verified the proofs in detail, the mathematical approach appears reasonable. My primary concern is the practical significance of the results. The representation theorem establishes an interesting connection, but it is unclear what this characterization provides for the design of practical operator architectures. The absence of numerical experiments makes it difficult to assess the utility of the proposed framework.
Critical strengths
The paper addresses an important and timely problem in neural operator learning. The representation theorem is an interesting theoretical contribution, and the variational formulation provides a unified perspective on several existing architectures. The mathematical development appears thorough, with explicit assumptions, proofs, and counterexamples.
Critical weaknesses
The primary weakness is that the practical implications of the theoretical results remain unclear. While the theorem establishes that a representation exists, it does not establish whether that representation can be learned or implemented efficiently, or whether it provides useful guidance for designing new architectures. The paper also provides no numerical experiments, even on a simple example, to demonstrate that the proposed framework offers practical benefits.
Questions for authors
-
What does the representation theorem provide beyond establishing the existence of a stable Markov kernel network? In particular, how does it inform the design or parameterization of practical neural operator architectures?
-
Can the authors demonstrate the utility of the proposed framework on a simple numerical example, particularly one where the variational formulation leads to improved discretization stability or another measurable advantage over existing architectures?
We thank the reviewer for the thoughtful comments and questions. Our general reply synthesizes our response to several inter-related concerns; (A) and (D) are particularly relevant to the points raised here.