- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces specialisation, a framework for adapting pretrained image generators into counterfactual image mechanisms using limited target-domain data. They introduce RadCF, which implements this framework through latent flow matching, structured metadata conditioning, and adaptation of both the transport model and autoencoder. Experiments examine acquisition shift, data scarcity, extension to new intervention variables, adaptation of text-conditioned generators, and downstream shortcut detection and mitigation.
Critical strengths
-
The paper addresses a very practically important problem, that counterfactual image models often require substantial annotated data and retraining for each domain. Reusing pretrained generators offers a useful route toward more accessible counterfactual modeling.
-
The evaluation is extensive and includes several valuable controls. These include comparisons using the same RadEdit backbone, six independent effusion evaluators, patient-level data separation, and downstream experiments with size-matched augmentation strategies. For example, the acquisition-shift experiments provide convincing evidence for adapting the autoencoder.
Critical weaknesses
-
The reported soundness metrics provide limited evidence of clinically faithful counterfactual edits. Effectiveness is measured using pseudo-oracle classifiers, while composition and reversibility primarily assess reconstruction and cycle consistency, and these criteria do not establish that an intervention preserves clinically relevant findings outside the four modelled attributes. A focused assessment of target attainment and preservation of unrelated pathology would strengthen the contribution.
-
The methodological advance beyond established adaptation techniques is insufficiently isolated. Section 3.2 combines LoRA, joint autoencoder–generator adaptation, and replacement of text conditioning with structured metadata. The distinction among structural, acquisition, and measurement specialisation is useful, but the technical contribution consists mostly of selecting and combining these existing adaptation strategies. For example, table 2 establishes the benefit of autoencoder adaptation and table 3 demonstrates improvements over Causal-Adapter on the same backbone but I do not believe these results do not fully explain which particular design choice produces the advantage.
Questions for authors
- How reliably do the interventions preserve clinically relevant findings outside the modelled attributes?
- Which specific component of specialisation accounts for its advantage over existing adaptation approaches, and can this be isolated experimentally?
3 comments
Response to Reviewer LEFC (Part II)
W2, Q2: The methodological advance beyond established adaptation techniques is insufficiently isolated.
W2: “The methodological advance beyond established adaptation techniques is insufficiently isolated. Section 3.2 combines LoRA, joint autoencoder–generator adaptation, and replacement of text conditioning with structured metadata. The distinction among structural, acquisition, and measurement specialisation is useful, but the technical contribution consists mostly of selecting and combining these existing adaptation strategies.”
Q2: “Which specific component of specialisation accounts for its advantage over existing adaptation approaches, and can this be isolated experimentally?”
R2. Rather than relying on a single dominant module or heuristically combining techniques, our core contribution is a framework that maps three distinct clinical dataset shifts: structural, acquisition, and measurement to components, building on Castro et al., 2020. By identifying which component requires updating under a given shift, our framework achieves clear advantages in data and parameter efficiency over naive adaptation.
Importantly, we experimentally examine the contribution of these adaptation choices. Section 4.1 (When is SA-SPEC necessary?, Table 2) directly compares joint VAE+generator adaptation with generator-only adaptation using a frozen VAE. Under CheXpert-to-NIH-14 transfer, even full generator fine-tuning does not recover SA-SPEC’s composition and reversibility benefits. Section 4.2 (Causal Text-to-Image Generation, Table 3) evaluates measurement specialisation on a second backbone family. Using the same pretrained RadEdit backbone, M-SPEC’s direct structured conditioning and LoRA generator adaptation improve target control, composition, reversibility and realism over Causal-Adapter.
These controlled comparisons directly address an open gap in prior work. Earlier SCM-based methods primarily study learning and inference for dataset-specific mechanisms (Ribeiro et al., 2023; Rasal et al., 2025; Ribeiro et al., 2025). Meanwhile recent adaptation studies (Yeganeh et al., 2025; Tong et al., 2026) only study adapting general-purpose pretrained models for medical or counterfactual generation. Our study explicitly tests that adaptation choice across clinical acquisition settings and connects it to counterfactual composition and reversibility, showing high practical value.
Response to reviewer LEFC
Dear Reviewer LEFC,
We hope our rebuttal has addressed your concerns and clarified the value of our work. We would be grateful for your feedback and support for the paper’s acceptance.
Thank you!
Authors
Response to Reviewer LEFC (Part I)
We thank the reviewer for recognising the practical importance of our work and the value of the experimental controls. Below, we provide an additional assessment of unmodelled pathological findings and clarify the contribution of each specialisation component.
W1, Q1: The reported soundness metrics provide limited evidence of clinically faithful counterfactual edits.
R1. We thank the reviewer for this suggestion. Upon request, we provide a focused assessment of non-target pathological preservation to further support the clinical faithfulness of our counterfactuals.
In this focused assessment, we examine whether predictions for unmodelled pathological findings remain consistent under view interventions. We focus on do(view) because changing between AP and PA views involves changes across the entire image, potentially affecting findings beyond the target attribute.
We compare predictions on original NIH-14 images and their view counterfactuals using two independent evaluators: RAD-DINO linear probes (Pérez-García et al., 2025b) and TorchXRayVision ResNet-50 (Version All, Cohen et al., 2022). For each finding, we report the percentage of original–counterfactual pairs whose predicted label changes. We include six findings that are not modelled by the SCM and for which the evaluators achieve an AUROC above 0.80 on factual images: pneumothorax, emphysema, mass, hernia, edema and cardiomegaly. Effusion, a modelled attribute held fixed during do(view), is included as a reference.
Despite the whole-image change required by the view intervention, predictions for the six unmodelled findings generally remain consistent among all models. And SA-SPEC follows closely behind the identifiable pixel-space flow. These results extend the assessment beyond reconstruction and cycle consistency to predictions of unmodelled pathological findings. We have added these results in Appendix B.4, complementing our existing evaluations.
Table R4. RAD-DINO: disease flip rate (%) under view intervention, with bootstrap 95% CI (10,000 resamples)
Table R5. TorchXRayVision ResNet-50 (All): disease flip rate (%) under view intervention, with bootstrap 95% CI (10,000 resamples)