- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes a certification layer that conditions a posterior inferred with SBI to check whether the posterior draw is well-posed, stable, and whether solver-error control is satisfied.
Critical strengths
/
Critical weaknesses
Figures
- The layout of Figure 1 strongly suggests that it was generated with AI: see typical artifacts in the blue figure. However, the AI use statement did not disclose that generative AI was used to create figures directly; please be more transparent if this is the case, and create the figures yourself.
- Figure 1: “Learn from N simulations and observed data y”. This statement is technically ambiguous and incorrect. NPE, NLE, and NRE do not use observed data to train a conditional density estimator. Thereby, a conditional density estimator is trained on both the parameters and simulations, which is not clear from the mathematical formulation .
- Figure 2:
- Limited experimental evidence of the benefit of the work
- Black/purple line is not properly visible, nor is it explained what it does.
- Caption: “inferred from the synthetic observations”: The wording is unclear. Which synthetic observations/experiments were used?
Reproducability
- No code has been shared
- No baselines
Unclear language
-
Unclear language; not using jargon from the field.
-
Unclear math, not using standard notations.
-
The paper does not reference any of the three figures within the text.
-
e.g., Line 14-15: “statistical accuracy of the learned posterior does not guarantee that every retained parameter value defines a mathematically well-posed continuous model, nor that an approximate solver is close to that model’s solution.”: Please make this sentence clearer. It is also not very clear what you mean by a “continuous model”.
-
e.g., Line 22-23: “The certification interface is compatible with neural posterior, likelihood, or ratio estimation and with classical or learned PDE solvers.” It is unclear why the certificate is stated to be compatible with SBI methods (NPE, NLE, NRE) and PDE solvers.
-
e.g.: Line 36-37: “Most SBI guarantees and diagnostics focus on the statistical layer: whether the learned posterior approximates the intended Bayesian target, whether inference is calibrated under repeated simulation, and how efficiently simulations are allocated”. The phrasing and corresponding citations are ambiguous and incorrect.
Extremely weak experiments
- Only 1 experiment has been performed, and it was not even performed on standard SBI methods (e.g., NPE, NLE, and NRE), although the abstract claims to work on those methods.
Questions for authors
/