- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies nonlinear dynamical inverse problems in which model parameters are estimated from observed trajectories. The focus is on settings with practically non-identifiable or "sloppy" parameters (meaning many parameter combinations produce similar observable behavior and parameter accuracy is not necessarily aligned with predictive performance). I am intimately familiar with this type of problem in the field of uncertainty quantification (UQ).
The proposed method is referred to as OIL (for "Optimizer-In-the-Loop"). As I understand it, the workflow is like this: a single NN is trained to predict parameters from observations by first predicting a parameter from an observed trajectory and then using this parameter estimate as the starting point for a small number of trajectory-matching optimization steps. These steps generate a sequence of refined parameter estimates and corresponding simulated trajectories. A loss is then computed from the resulting optimized trajectory, which is then backpropagated through the optimization process to update the NN weights. The idea is that this NN should learn to produce parameter estimates that are better starting points for subsequent trajectory matching (a downstream task).
From a UQ perspective, this resembles a multi-fidelity inverse-problem workflow in which a learned coarse inverse solver is followed by a more expensive optimization-based refinement stage. In classical multi-fidelity approaches, the lower-fidelity component is usually a surrogate for the forward model, whereas here where the NN approximates the inverse solution itself. Nevertheless, the workflow follows a familiar principle of obtaining a cheap approximate solution and then refining it through a more accurate optimization procedure.
The validation is done on the generalized Lotka-Volterra systems (of varying dimension) together with a couple of other systems. The evaluation considers parameter-estimation accuracy, trajectory-reconstruction accuracy, forward-simulation validity, posterior diagnostics, and Fisher-information-based sensitivity geometry. The empirical findings show that these metrics can disagree substantially in "sloppy" inverse problems, which is consistent with expectations from the inverse-problems and UQ literature.
Overall, the paper's primary contribution is not a new inverse-problem formulation, but rather an optimizer-aware amortized estimator that learns how to initialize a trajectory-matching inverse solver. In that sense, its strongest contribution is the extensive empirical studies provided (most of which are found in the appendix). Its principal limitation is that the underlying methodology is largely a synthesis of existing ideas from learned initialization, differentiable optimization, and amortized inference rather than a fundamentally new theoretical framework, but that is mostly coming from my UQ background. I think the paper would be of interest to the ICLR crowd.
Critical strengths
-
I believe the strongest aspect of the paper is the empirical study rather than the OIL method itself. While the disagreements among the metrics is widely expected by UQ practitioners, it does highlight an important practical issue that accurate parameter estimates from NNs are likely insufficient for many downstream tasks.
-
OIL is a principled approach for training a NN estimator to act as an effective initializer for any subsequent trajectory matching. I believe the approach is also straightforward enough for most people to incorporate.
Critical weaknesses
- The methodological novelty is a bit limited. The core idea can largely be interpreted as a learned warm-start strategy for trajectory matching that combines many existing ideas and is similar philosophically to approaches used in UQ for inverse problems.
Questions for authors
How much of the observed improvement comes specifically from training through the trajectory-matching optimization steps, as opposed to simply training a NN estimator that provides a good initial guess for trajectory matching?