- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies post-hoc correction for frozen multimodal models under missing modalities and proposes GUARD. It characterizes correctable error as the Bayes gap, which distinguishes the model's overall error from the portion that can be corrected using only the currently observed modalities, and replaces retrieval labels with the outputs of a richer-view model when that model is conditionally correct. On this basis, GUARD constructs a candidate correction and then calibrates a threshold via conformal risk control to limit harmful interventions. The paper provides theoretical proofs and validates the performance of the proposed approach through experiments.
Critical strengths
The paper distinguishes between "correctable error" and "irreducible ambiguity," and on this basis establishes a risk-controlled post-hoc correction framework. The Bayes-gap analysis convincingly shows that the observed magnitude of performance degradation does not directly determine the model's correctable headroom; GUARD further decouples the construction of a candidate correction from the decision of whether to apply it, and uses conformal risk control to provide a finite-sample guarantee on the marginal joint probability of harmful intervention. This makes the method attend not only to average performance gains but also to explicitly constraining the negative risk that correction may introduce.
Critical weaknesses
The paper's core methodological increment relative to existing retrieval-based correction, selective prediction, and conformal risk control methods remains insufficiently clear. GUARD combines correction, a learned action score, and conformal calibration, and further controls joint harm through fit-split tightening. The authors have conducted several ablation studies, including comparisons with confidence scores, Learn-then-Test, different correction targets, and retrieval versus probe variants. However, these experiments still cannot fully distinguish whether GUARD's performance gains stem from its specific overall design or from a combination of existing correction methods and risk-calibration mechanisms.
Questions for authors
If the same correction candidate is fixed, and only GUARD’s learned action score together with the conformal threshold are compared against simpler selective or conformal gating baselines, do GUARD’s performance gains still hold? The authors are encouraged to further clarify the respective effects of the learned action score, conformal calibration, and other key components on the final performance gains and joint harm.