- Rating
- 3(+1)
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper examines the harmful changes that training-free hallucination mitigation methods can introduce into vision-language model predictions, even when overall accuracy improves. The authors propose RAPIC, a post-intervention controller that compares the original and modified answers and uses the frozen backbone to replay the modified output when the two differ. Based on replay-consistency features and thresholds calibrated on labeled examples, RAPIC decides whether to keep the modified answer or revert to the original one. The method is mainly evaluated on POPE across different vision-language models and mitigation methods, with additional experiments on routing strategies, calibration, multiple-choice VQA, and image captioning.
After Rebuttal
Critical strengths
(i) The paper addresses an important reliability problem in hallucination mitigation. Average accuracy improvements can conceal harmful changes to individual predictions, and examining these changes provides a useful perspective for evaluating inference-time interventions.
(ii) The experiments cover three vision-language models, multiple hallucination mitigation methods, and three POPE datasets. The paper reports confidence intervals for the main results and includes settings where RAPIC provides little improvement or even causes slight performance degradation, giving a more complete picture of its empirical performance.
Critical weaknesses
(i) The proposed post-intervention risk control formulation is not clearly distinguished from existing selective prediction and post-hoc correction methods. Section 3.1 defines helpful and harmful intervention-induced changes, while Eq. (2) describes the accuracy change when selected predictions are reverted to the baseline. RAPIC then uses replay-based likelihood and margin features to rank changed answers and selects fallback thresholds using labeled examples. Although the paper identifies its focus on intervention-induced changes and same-backbone replay as differences from prior work, it does not clearly explain why these constitute a distinct risk-control framework rather than a calibrated selective fallback procedure applied to hallucination mitigation.
(ii) The results raise questions about whether RAPIC consistently identifies harmful changes at the individual-sample level. Appendix C.5 reports that replay scores provide little separation between harmful and helpful No-to-Yes changes, with an AUROC of only 0.52–0.58. Table 9 further shows that RAPIC reverts 147 of 152, 86 of 91, and 87 of 89 No-to-Yes changes across the three POPE datasets in the primary setting. This is effectively a near-complete rollback rather than selective identification of harmful changes in this direction. Although the paper shows stronger separation for Yes-to-No changes, the results do not clearly establish whether RAPIC provides effective sample-level discrimination for No-to-Yes changes, beyond relying on the overall proportion of harmful changes in that direction.
Questions for authors
(i) Please clarify what distinguishes the proposed post-intervention risk control formulation from existing selective prediction and post-hoc correction methods, and how the replay-consistency score relates to the intervention risk defined in Section 3.1.
(ii) Please explain whether RAPIC genuinely identifies harmful changes at the individual-sample level and how this ability is demonstrated.
3 comments
I appreciate the authors' detailed response and the additional evidence, which have addressed my main concerns. I suggest incorporating the clarifications provided in the rebuttal into the revised manuscript to make the contributions and conclusions clearer. And I will raise my rating.
Thank you for raising your rating and for the constructive suggestion. Following your advice, we have incorporated the clarifications from the rebuttal into the revised manuscript. We appreciate your time and engagement throughout the discussion.
Thank you for the precise questions. In short: RAPIC is a fallback rule like selective prediction, but it decides a different thing using information from a different model, and this difference is what makes it work.
(i) Distinction from selective prediction and post-hoc correction.
Of these, the difference that matters empirically is the signal. Under the same candidates, fallback action and supervision (Table 3, MSCOCO):
The deployed model's own uncertainty does not help; the gain comes from the pre-intervention model's support.
Link to the risk in Sec. 3.1. Reverting a changed candidate x replaces aM by aB, so its expected contribution to Eq. 2 is P(aB correct∣x)−P(aM correct∣x). For a binary changed candidate exactly one answer is correct, so
E[Δfb(S)]=N1∑x∈S(2P(aB correct∣x)−1),
and fallback helps exactly when P(aB correct∣x)>1/2. Replay scores the intervention's answer under the frozen backbone, and its first step is the backbone's own distribution on (I, q) (99.5% argmax agreement with the recorded baseline answer). Weak support for yM therefore means that the backbone prefers aB, and it is a proxy for this probability to the extent that the backbone's confidence ranks the correctness of its own answers; the calibrated threshold estimates where the probability crosses 1/2. This ranking ability is high for "Yes" predictions (AUROC .927, RePOPE labels) and low for "No" predictions (.747), which is why the two directions behave differently in (ii). We will add this derivation to Sec. 3.2.
(ii) Does RAPIC identify harmful changes at the sample level? For Yes→No, yes. For No→Yes, your reading is correct, and below we explain why a direction-level decision is the right policy there rather than a failure. Primary setting (LLaVA-1.5 + VGA, Table 9; MSCOCO / AOKVQA / GQA):
Yes→No selection holds under corrected labels: on the RePOPE-matched subset its AUROC is .804 with original and .859 with RePOPE labels, and RAPIC's overall gain over VGA increases from +1.21 to +1.75 pp. Further, the top replay-risk quintile is 87.7% harmful (Fig. 3c).
No→Yes changes help only when the baseline's "No" was wrong, and such errors are rare and poorly ranked. The baseline's "No" predictions are 90–96% accurate; on RePOPE-matched MSCOCO, 197 of the 319 POPE "No" errors are actually correct, and 24 No→Yes changes counted as helpful become harmful. The remaining errors are also hard to rank: the baseline's confidence has AUROC .747 for its "No" predictions vs. .927 for its "Yes" predictions (difference 95% CI [+.11, +.26]). Because these errors are poorly ranked, no selection rule can do much better than reverting the whole direction or keeping it; because they are rare, most No→Yes changes are harmful (AOKVQA, GQA), so reverting the whole direction is the better of the two. A direction-level decision is therefore near-optimal, and RAPIC's result is indeed indistinguishable from it (difference CIs include zero). The same direction-specific calibration thus yields sample-level selection where the scores separate harmful from helpful changes (Yes→No) and an effectively direction-wide decision where they do not (No→Yes), without being told which case applies. We will make this distinction explicit in Sec. 4.