- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper considers the physics-informed learning setting through the lens of PAC-Bayesian generalization. The paper leverages the input gradients of the data fit loss and the physics-informed regularization to characterize the complexity. The main contribution of the paper seems that the certifications can be computed in a tight manner. It seems that there is no proof in the paper to characterize how physics improves prediction accuracy.
Critical strengths
The paper is really interesting, well-written and easy to follow. This idea of unsterstanding how the physical knowledge affects the complexity of the learning problem is very important and have been addressed by some papers in the literature that provide complexity dependent bounds for physics informed learning.
- “Physics-informed learning under mixing: How physical knowledge speeds up learning”
- “Physics-informed machine learning as a kernel method”.
- “Complexity Dependent Error Rates for Physics-informed Statistical Learning via the Small-ball Method”
I enjoyed reading this paper!
Critical weaknesses
The main drawback for me is that the paper explicitly leaves open how physical constraints affect generalization of the data fit loss. From the complexity dependent bounds in the papers mentioned above, it seems that it might be a way to extend excess risk bounds to generalization bounds, understanding how the physical knowledge reduces the complexity of the hypothesis class. I feel that the same reasoning could also be applied through the lends of PAC-Bayes, by optimizing over the priors. Maybe the authors could provide more intuitions on that.
In terms of scalability I would like to understand how this PAC-Bayes could be used for more complexity dynamics and physical lows. For example complex, coupled, and multi-output PDEs.
Questions for authors
See the weakness section