- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes context-conditioned observation corrections for a neural posterior estimator under simulator misspecification. Two population residual-prediction ceilings are intended to guide the choice between context-only and observation-dependent correctors. The paper also develops pairing-free variants and evaluates the approach on synthetic benchmarks, physical datasets, and negative controls.
Critical strengths
-
The practical motivation is relevant. Recorded operating conditions may help explain systematic simulator discrepancies, and correcting inputs while reusing a pretrained posterior estimator is a convenient workflow.
-
The paper reports substantial failures and limitations. The negative physical and epidemiological results, together with the Gaussian-linear analysis of bootstrap attenuation, provide useful information about the method’s scope.
Critical weaknesses
-
The proposed ceilings do not adequately justify the corrector selection rule. The ceilings quantify optimal residual prediction in observation space, but their relevance to posterior inference is only theoretically established under restrictive Gaussian-linear assumptions. It remains unclear whether a larger ceiling translates into better posterior accuracy or calibration for general nonlinear NPE models. Furthermore, the estimated ceilings depend on fitted regressors and may underestimate population predictability due to fitting error. Finally, Algorithm 1 in Appendix B.4 stops when , even though may still make observation-dependent correction useful.
-
Observation-space correction does not establish reliable posterior repair. The proposed correctors minimize residual prediction error in observation space, but the experiments do not sufficiently demonstrate that this translates into reliable posterior inference. Real-data improvements are limited and inconsistent, while reductions in posterior-mean error do not establish calibrated uncertainty. The reported coverage results raise further concerns about whether the method reliably improves the full posterior distribution.
Questions for authors
-
Why use ceiling-based selection instead of directly comparing the two correctors on held-out calibration data? Since estimating the ceilings already requires fitting residual regressors, it is unclear what advantage the proposed selection rule provides over standard validation-based selection. Does it improve selection accuracy or reduce computational cost?
-
Does the proposed correction reliably improve posterior calibration rather than only point estimation? The real-data experiments emphasize posterior-mean error, while empirical coverage remains poor or inconsistent in several settings. Can the authors clarify whether the corrected posteriors consistently improve coverage over the uncorrected NPE, and explain the remaining calibration failures?
-
Is the necessity condition in Theorem 5 correct? Consider a parameter space containing only two values and two contexts with positive probability. Suppose the two parameters induce identical conditional distributions in one context but distinct distributions in the other. The joint distributions of ((y,z)) are then distinguishable, although slice-wise injectivity fails on a positive-measure set of contexts. Does this contradict the claimed equivalence?