- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper develops an uncertainty-aware hybrid physics-informed machine learning architecture that attaches an Epistemic Neural Network to a pre-trained HPIML model. Based on this, the paper also proposes an adaptive mechanism, built from monotone function approximators, that uses this uncertainty to rebalance the physics and ML terms of HPIML, with theoretical guarantees on both its convergence and the coverage of its uncertainty estimate.
Critical strengths
This paper develops an uncertainty-aware hybrid physics-informed machine learning architecture that attaches an Epistemic Neural Network to a pre-trained HPIML model.
Critical weaknesses
- I do not think the EPIC-PIML-Based MPC is a novel contribution. It is more like a direct use of the learned dynamics model for MPC. Besides, I suggest a critical comparison of EPIC-PIML-based MPC with an adaptive controller, rather than the simple PHY-based MPC. At a high level, they are similar. The adaptive controller uses the real-time states to estimate model mismatch or uncertainty, and then uses the estimation to compute a control input to compensate for the unknown model mismatch. More importantly, adaptive control does not face the latency issue.
- The comparison experiments are not sufficient and lack critical information. Specifically, the paper compares PIML. In recent years, significant frameworks for PIML have been proposed, such as deep Koopman, Physical World Model, and Physics-Enhanced State Space Model. Which models are used for comparison? Moreover, the critical information about the training model is missing. For example, how are the control commands in the training dataset obtained? Are the control commands in the training dataset realizable? If they are reliable, why not directly train the network to output the control commands (given input of system states) and compare it to the MPC? Meanwhile, the paper claims that the proposed framework can address the out-of-distribution problem well. To have a more convincing demonstration, the testing dataset should have a different distribution from the training and evaluation datasets, rather than only from different tracks.
Questions for authors
- Some critical descriptions are missing, rendering the paper hard to follow. For example, in Eqs. (2) and (3), what are the meanings of z_{k} (outputs of the previous NN)? What is the physical meaning of the reference features? I suggest adding concrete examples to clarify these points.
- Section 4.2 discusses the adaptive weight \alpha but does not present the detailed functional forms. Are the functions unique?
- I do not think the EPIC-PIML-Based MPC is a novel contribution. It is more like a direct use of the learned dynamics model for MPC.
- The comparison experiments are not sufficient and lack critical information. For example, the paper compares PIML. In recent years, significant frameworks for PIML have been proposed, such as deep Koopman, Physical World Model, and Physics-Enhanced State Space Model. Which models are used for comparison?
- The critical information about the training model is missing. For example, how are the control commands in the training dataset obtained? Are the control commands in the training dataset realizable? If they are reliable, why not directly train the network to output the control commands (given input of system states) and compare it to the MPC?
- I suggest a critical comparison of EPIC-PIML-based MPC with an adaptive controller, rather than the simple PHY-based MPC. Because, at a high level, they are similar. The adaptive controller uses the real-time states to estimate model mismatch or uncertainty, and then uses the estimation to compute a control input to compensate for the unknown model mismatch. More importantly, adaptive control does not face the latency issue.
- All the experiments are performed in simple simulators, implying that the obtained theoretical results may not hold in the real physical world, as the physical operating environments are much more complex and non-stationary.
- The paper claims that the proposed framework can address the out-of-distribution problem well. To have a more convincing demonstration, the testing dataset should have a different distribution from the training and evaluation datasets, rather than only from different tracks.