acceptodds
Under review as a conference paper at ICLR 2027

ValidCF: Evaluating Synthetic Counterfactual Evidence in Medical Vision-Language Models

Abstract

Synthetic counterfactuals are increasingly used to evaluate medical vision-language models (VLMs). They test whether a model responds to clinically meaningful visual changes. However, the editing process can also introduce unintended changes. This creates a fundamental question: Did the model respond to the intended clinical change or to the editing process itself? We introduce ValidCF, a framework for evaluating synthetic counterfactual evidence before using it to interpret medical VLM behavior. ValidCF pairs each clinical counterfactual with a matched sham intervention. The sham follows the corresponding editing pipeline while preserving the target clinical state. This provides a control for measuring editing-associated response instability. ValidCF also examines intervention validity evidence and consistency across independent counterfactual generators. Uncertain interventions can then be accepted, deferred, or rejected rather than treated as equally reliable evidence. We evaluate ValidCF on 500 patient-distinctchest radiographs using two independent counterfactual generators and a medical VLM. We find a striking disagreement between conventional counterfactual evaluation and sham-controlled analysis. The generator with higher clinical transition accuracy also produces substantially greater response changes under sham interventions. Once this instability is considered, the apparent comparison between the generators reverses. Our findings show that an expected response to a counterfactual edit is not, by itself, sufficient evidence of clinical sensitivity. The intervention used to produce that evidence must also be evaluated. ValidCF provides a controlled approach for distinguishing intended clinical responsiveness from sensitivity to the editing process.

Primary area:
applications to computer vision, audio, language, and other modalities
Keywords:
medical vision-language models, counterfactual evaluation, trustworthy AI, visual grounding, intervention validity, negative controls, uncertainty, three-way decision

Reviews

Among:
Shape:
1234this paper, Bottom 1%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.00 over 3 reviews, above 0% of the others.
Reviewer_QXqtOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

This paper asks whether a medical VLM's response to a synthetic counterfactual edit reflects the intended clinical change or the editing process itself. The authors propose ValidCF, which pairs each clinical counterfactual with a "sham" edit from the same generator that is supposed to keep the target finding unchanged. They define Sham Flip Rate (SFR, how often the VLM's answer changes under the sham), Clinical Transition Accuracy (CTA, how often the VLM gives the expected answer on the clinical edit), and Matched Response Contrast (MRC = CTA − SFR). They also build an automated "intervention evidence" score (SIV) from six proxy terms (classifier outputs, SSIM, MAE, cross-generator agreement) and map it to Accept / Defer / Reject with two hand-set thresholds. Experiments use 500 NIH ChestX-ray14 images (pleural effusion, edited in both directions), two editors (RadEdit, InstructX2X), and one VLM (CheXagent-2-3b). InstructX2X has higher CTA than RadEdit (73.4% vs 67.0%) but a much higher SFR (44.8% vs 11.6%), so RadEdit gets a higher MRC (55.4% vs 28.6%). The authors conclude that CTA alone is not enough to judge counterfactual evidence, and that the editing pipeline itself should be evaluated.

Critical strengths
  1. The question is a good one. Synthetic counterfactual edits are increasingly used to test whether medical VLMs look at the right evidence, and it is true that a response change after an edit does not by itself show the model reacted to the clinical content. Using a negative-control (sham) condition is a simple and sensible idea that could be applied to existing editors without retraining anything. This is why I think the paper is worth discussing, even though I do not think it delivers on its claims.

  2. The paper is fairly honest about what it does not show. The authors state that the sham is not the true patient counterfactual, that MRC is descriptive and not causal, and that SIV weights and thresholds are design choices rather than clinically calibrated. The observation that the two editors behave very differently under the sham (44.8% vs 11.6% flips) is a useful warning for people who rely on edit-based evaluation, even if I think the evidence is too thin to support the stronger conclusions.

Critical weaknesses
  1. The experiments do not support the main claim. The motivation (a model reacting to a synthetic edit is not the same as the model understanding real clinical change) is reasonable, and I agree with it. But the paper never tests anything real. All the evidence comes from two off-the-shelf editors applied to a single X-ray dataset. There is no real longitudinal data (NIH ChestX-ray14 has follow-up studies, MIMIC-CXR has sequential studies, and MS-CXR-T has temporal pleural effusion labels), and no radiologist review of the edits. The sham is just another edit from the same generator, so what it measures is how unstable one generator is under one kind of "do-nothing" edit. It says nothing about real clinical change, and not much about "the editing process" in general. The authors themselves admit (Sec. 4.2) that sham and clinical edits may have different nuisance distributions, which undercuts the abstract's claim that ValidCF separates "intended clinical responsiveness from sensitivity to the editing process." The headline "reversal" is also partly an artifact of the authors' own metric: MRC = CTA − SFR subtracts two different quantities (accuracy against an expected answer vs. any change from the original answer), and the 33-point SFR gap trivially outweighs the 6-point CTA gap. No confidence intervals or significance tests are given for CTA, SFR or MRC, with only 500 cases and a single run.

  2. The sham and the measurements are under-specified, and the scope is too narrow for the general claims. The most important object in the paper, the sham edit z^sham (Eq. 2), is never defined. I could not find the prompts or instructions, masks, edit strength, sampling steps or seeds used for each generator. It is also unclear what "matched" means (same region? same edit size?), and how "target-preserving" was verified (only by a classifier and SSIM, not by a human). The 44.8% flip rate for InstructX2X may simply mean that a "no change" instruction is out-of-distribution for that model, and not that it is generally unstable. CTA is the VLM's accuracy on the edited image, so calling it the generator's "clinical transition accuracy" mixes up editor failure and VLM failure. The SIV score uses hand-picked weights and proxy metrics (SSIM, MAE), contains a sham term that partly repeats the sham finding, and is never checked against clinician judgement, so it is unclear what Accept/Defer/Reject actually mean (only 0.6% are rejected). The study also covers one modality (chest X-ray), one dataset with noisy text-mined labels, one finding (pleural effusion), 500 images, one 3B VLM, and two editors. I do not think any general conclusion about "medical VLMs" or "counterfactual evidence" can be drawn from this.

  3. Presentation and missing statements. Figure 1, the main figure, is a plain left-to-right box diagram with tiny text; the first and last boxes are cut off at the edges, and it does not show the core idea (the clinical/sham pair and what is compared). It also uses names that do not match the text (v_anat, v_art, p_valid vs. v_struct, v_img; SIV described as "not a probability" in the text), and it needs a lot of redrawing. Key experimental details are missing (VLM prompt and answer parsing, which classifier is used, per-direction results). The paper says there are 3,000 VLM queries but only 2,500 images are described. I also could not find an AI/LLM usage statement, which is required this year, nor an ethics or reproducibility statement or code link.

Questions for authors
  1. How exactly is the sham built for each generator (instruction/prompt, mask, strength, steps, seeds)? Is it matched to the clinical edit in region and magnitude? Has a radiologist checked, on at least a subset, that the sham really leaves the effusion status unchanged? Would a trivial control (re-encoding the image, small noise, or an auto-encoder round trip) give similar SFR numbers? Please also report results separately for Present→Absent and Absent→Present.

  2. Can you show that SFR, MRC or SIV tracks anything real? For example, on real follow-up pairs (e.g., MS-CXR-T, MIMIC-CXR sequential studies), or by showing that SIV agrees with expert ratings of edit validity. Also, does filtering to "Accepted" interventions change any conclusion about the VLM? Without this, I cannot tell whether ValidCF is useful or just an extra score.

  3. Please clarify the metrics. (a) Could the "reversal" survive other reasonable ways of combining CTA and SFR, such as computing both only on cases where the original answer was correct, or using direction-specific flips, and what are the confidence intervals? (b) Why are there 3,000 VLM queries when only 2,500 images are described? (c) Was CheXagent trained or tuned on NIH ChestX-ray14, and could that affect the results?

Reviewer_hMHpOpenReview ↗
Rating
1
Confidence
3
Informativeness
2
Presentation
1
Soundness
1
Read review
Paper summary

This paper introduces ValidCF, a framework which aims to distinguish image editing-associated response instability from actual clinical effects when counterfactual edits are made to medical images. It proposes the use of sham interventions as a control, which follow an identical image editing pipeline as counterfactual edits without changing the clinical state. ValidCF is tested on a single medical VLM with 500 chest radiographs and 2 counterfactual image generators. Results indicate that high clinical transition accuracy in a generator can also be associated with greater response changes under the sham interventions, demonstrating that counterfactual interventions need to be evaluated relative to similar sham interventions to disentangle the effects driving a response change.

Critical strengths
  1. This work addresses an important issue with the use of synthetic counterfactuals for evaluating VLMs whereby response changes are confounded with the effects of the image editing pipeline, which can lead to flawed evaluations.

  2. The use of a sham intervention is a simple yet intuitive approach that can be added to existing counterfactual evaluations for VLMs.

Critical weaknesses
  1. Many aspects of the proposed approach are lacking validation or even a description of how the authors arrived at their particular methodological design choices. For example, how was the accuracy of the pretrained chest-radiograph classifier validated (L178-179)? Why these particular six evidence terms (Eq. 6-11)? How were the weights for Equation 12 chosen? How were the “automated evaluations” (L246-247) conducted and validated? How did you choose the fixed thresholds for alpha and beta (L223)?

  2. The empirical evidence is limited to a single VLM and one clinical condition (pleural effusion), evaluated using 500 original images. The relatively small-scale of the experiment setup, in conjunction with the lack of clarity on how various aspects of the methodology were designed, makes me question how well this approach will generalize to other settings. I also wonder if the higher sham flip rate could be at least partially attributed to the sham intervention moving the image closer to a more ambiguous / difficult to classify case. The lack of any human evaluation of the edited images makes it difficult to assess the validity of the sham interventions.

Questions for authors

See questions in weakness #1 above.

Reviewer_MR7QOpenReview ↗
Rating
1
Confidence
2
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

This paper presents a framework to probe synthetic counterfactual images used to evaluate medical VLMs. In short, the authors pair each counterfactual edit with a sham intervention on the original image that does not change the clinical state, using the sham to offset the unintended effects on the VLM outputs caused by the image editing pipeline. The medical VLM is evaluated under this paired setting and shows different levels of sensitivity to counterfactual & sham edits, as well as the editing model being used.

Critical strengths
  • The paper is well motivated and identifies the fundamental limitation of evaluating VLM behavior with synthetic counterfactual data vs. real image input. The idea to control with sham/null edits is natural and reasonable choice.
Critical weaknesses
  • Despite the introduction of sham intervention and the automated validation pipeline, there is no guarantee that the counterfactual samples are clinically correct without expert validation. This makes it difficult to draw any meaningful conclusions with regard to the eventual counterfactual edit quality.
  • Overall the scale and depth of empirical results are weak for ICLR standards, with one VLM and two editing models on 500 source images. The two editing models produce vastly different evaluation results, yet there are no mechanistic analysis or qualitative examples to explain the gap, which defies the motivation of offsetting the unintended effect of the editing pipeline in the first place.
  • The paper lacks any implementation details of the intervention and evaluation process which hurts its reproducibility and potential to extend beyond medical image analysis.
Questions for authors

Can the authors clarify how the sham interventions are made, e.g. through a null edit on the original image, or by performing a second counterfactual edit to clip the clinical state back to original?

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.