- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper addresses the challenge of learning a regionally stable nonlinear system, i.e., a nonlinear system with local input-to-state stability guarantees. The approach is based on a parametrization of a Lur'e system and an LMI condition ensuring regional stability within a polyhedral domain. This LMI condition is incorporated into the training procedure of identifying the model parameters to learn systems with regional stability guarantees. The approach is demonstrated in several numerical benchmarks on small- to medium-scale nonlinear systems.
Critical strengths
-
The new LMI condition enforcing regional stability appears novel to me. It provides a rigorous way of establishing regional stability with concrete estimates on both the subset of state space and input space that ensure local input to state stability
-
The paper is written clearly and is comprehensible for someone with a control theory background. Thank you
Critical weaknesses
- The numerical experiments are limited to small-scale systems where the proposed approach has on the order of 10s to 100s of trainable parameters. This does not seem comprehensive enough to address the scalability of the approach or how it handles systems with more states. Is this approach applicable to a control environment like those in Gym / RL training environments?
Questions for authors
-
Why not address regional stability in the following manner: first identify the region in which local ISS holds, then fit an existing model with global guarantees in this region?
-
The paper studies dynamical systems affected by disturbances. Are there versions of these results that extend to control systems where the user designs the control input?
-
The matrix in equation (13) is not defined
-
Any training approach that relies on solving SDPs at each iteration is fundamentally limited in the scale of problems that it can handle. Is there any way to circumvent the LMI constraints by directly constraining the conditions to hold via a parametrization? I can see the challenge in training in Table 3 where even a 1D nonlinear system takes 2 hours to train using the proposed approach.
We thank the reviewer for the comments.
Regarding the Gym/RL environments:
The open-loop dynamics of the classical-control environments in Gym RL are not regionally stable. Our certificate requires a regionally exponentially stable equilibrium, so it does not apply to these systems directly. It does apply to the closed loop of such an environment with a stabilizing policy, which is a typical regionally stable system: a balancing policy keeps the cart-pole upright only for a bounded range of states and disturbances.
Below, we address the questions raised by the reviewer:
1.) The main contribution of our approach is that
(a) we derive conditions for regional stability that provide an invariant state set and output set and a set of admissible inputs for which the model is input-to-state stable and
(b) we develop a training algorithm that discovers the regional stability certificates while minimizing the model's prediction error.
From the description of the reviewer’s proposed approach, it is not clear how global ISS can be achieved while keeping it only in a specified region for an existing model. Moreover, discovering the stability region is precisely what our architecture provides.
2.) The closest related work that operates in a closed-loop setup is the reference La Bella et al. (2025).
3.) Thanks, we will add the missing definition.
4.) The semidefinite program does not have to be solved in every optimization step. It is solved only when
(i) the new parameters are not feasible or
(ii) the input trajectory is not in the input set.
Embedding the constraints into the model parameters, enabling unconstrained optimization, is not trivial and left for future work.