- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The authors propose PROBE, a training-free framework for automatically discovering spurious visual cues and evaluating shortcut reliance across image classifiers. The framework consists of DISCOVER, which uses VLM-generated cue hypotheses and counterfactual image editing to assess classifier confidence changes, and SCORE, which generates synthetic probes to compare shortcut reliance across different architectures.
Critical strengths
1. Important and Practical Problem.
The paper addresses the important problem of automatically identifying spurious cues learned by image classifiers and comparing shortcut reliance across different architectures, without requiring manually annotated bias attributes.
2. Broad Experimental Coverage and Useful Supplementary Analyses.
The authors evaluate PROBE across multiple datasets and classifier architectures, including CNNs, vision transformers, and vision-language models. They also provide supplementary analyses of VLM and editor sensitivity, synthetic probe fidelity, and the relationship between confidence shift and real-image robustness. These analyses are valuable for understanding both the capabilities and limitations of the proposed framework.
Critical weaknesses
1. Insufficient validity of counterfactual cue attribution.
The DISCOVER stage identifies spurious cues based on classifier confidence changes after individual counterfactual edits. However, the method does not sufficiently verify whether the edits preserve object identity and other relevant visual attributes. Consequently, confidence changes may result from unintended modifications or editing artifacts rather than the targeted cue. Furthermore, evaluating each cue independently may overlook interacting or redundant shortcuts, as removing one cue may have little effect when other shortcuts remain available.
This is a fundamental concern because the reliability of the discovered spurious-cue inventory is central to the proposed framework. Without stronger evidence that the confidence changes reflect the intended cue interventions, the resulting bias assignments remain difficult to trust.
2. Insufficient Validation of the Proposed Shortcut Scoring Metrics.
The SCORE stage is a central contribution of the paper, but it remains unclear whether the proposed metrics reliably measure shortcut reliance. The authors report that confidence shift has a weak association with real-image group robustness. Moreover, a VLM-based fidelity audit (Section 4.1 and Appendix G.12) identifies errors in the synthetic probes: the target object remains present in 41/400 (approximately 10%) bias-stripped images and is absent from 102/381 (approximately 27%) real-cue-only images.
Although the authors provide post-hoc fidelity filtering experiments, it is unclear how much these generation errors affect the reported scores and classifier rankings. This is a critical concern because the paper's main contribution is to compare shortcut reliance across architectures, yet the results may partly reflect image-generation errors rather than actual differences in shortcut reliance.
Questions for authors
1. Novelty relative to prior work.
How does DISCOVER differ from MDC [1] and SaMyNa [2] ? In particular, MDC already combines attribute hypothesis generation, counterfactual image editing, and hypothesis testing for model diagnosis. Could the authors clarify DISCOVER's specific methodological contributions and compare its bias discovery performance with these approaches?
2. Reliability of counterfactual interventions.
How do the authors distinguish confidence changes caused by the intended cue modification from those caused by unintended changes or editing artifacts? Do DISCOVER's cue assignments remain reliable when using independently verified edits?
3. Multiple interacting shortcuts.
How does DISCOVER handle interacting or redundant shortcuts? Could its per-cue confidence threshold miss important shortcuts when removing one has little effect but removing several causes a substantial prediction change? A controlled multi-shortcut benchmark such as UrbanCars [3] could help clarify this issue.
4. Reliability of SCORE rankings.
How do the reported synthetic probe generation errors affect the SCORE results and classifier rankings? In particular, do the main conclusions remain consistent after excluding invalid images, as investigated in Appendix G.12?
[1] Chen, X., et al. (2025). Model Diagnosis and Correction via Linguistic and Implicit Attribute Editing. CVPR.
[2] Ciranni, M., et al. (2025). Say My Name: a Model's Bias Discovery Framework. TMLR.
[3] Li, Z., et al. (2023). A Whac-a-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Others. CVPR.
5 comments
Response to Reviewer HiUr (2/2)
W2.3 — Effect of generation errors on scores and rankings
As detailed in Q4, we added a controlled comparison that isolates the effect of fidelity filtering by holding the evaluated 78 classes fixed. Removing flagged renders changes the measured scores but preserves the classifier pairs defining the extremes of all three SCORE rankings (App. Table 25 and new Table 26).
Q1 — Comparison with MDC and SaMyNa
DISCOVER differs from MDC and SaMyNa in three key respects: it does not require model errors, tests individual cues through counterfactual confidence changes, and explicitly distinguishes object-intrinsic from spurious cues.
SaMyNa extracts ranked keywords from image captions without counterfactual testing or separating object-intrinsic from spurious features. MDC goes further by identifying attributes shared by misclassified examples and testing their influence through image editing and accuracy changes. However, its discovery is restricted to model errors, and it does not explicitly separate intrinsic from spurious attributes.
In contrast, DISCOVER can identify dependencies even when a classifier predicts correctly. It proposes open-vocabulary cues, tests each through targeted edits, and categorizes them using the classifier's confidence response. Furthermore, these inventories feed into SCORE, enabling shared cross-architecture evaluation rather than stopping at cue discovery (Sec. 2–3).
Q2.1 — Separating intended cue effects from editing artifacts
While we do not independently verify every edit, two complementary checks support the reliability of DISCOVER's outputs. Replacing FLUX with InstructPix2Pix yields 93% agreement on cues verified by both editors (App. G.17). Furthermore, the resulting cue inventories agree with independent reference annotations across Salient ImageNet, Hard ImageNet, and NICO++. Together, these results provide evidence that DISCOVER's findings are not solely driven by artifacts of a particular image editor.
Q2.2 — Reliability of cue assignments on independently verified edits
Our validation focuses on the resulting cue inventories rather than independently verifying individual edits. We evaluate these outputs against reference annotations from Salient ImageNet, Hard ImageNet, and NICO++, finding strong agreement in cue recovery and the identification of documented spurious features. These provide independent evidence for the reliability of DISCOVER's outputs.
Q3.1 — Can the per-cue threshold miss interacting or redundant shortcuts?
As detailed in W1.2, we added a joint-removal experiment to test this concern. Across 100 classes, only 0–3 classes per classifier exhibit a threshold-crossing confidence change under joint removal when no individual cue removal does. This suggests that single-cue testing captures most dependencies detectable through joint removal in our experiments.
Q3.2 — Evaluation on UrbanCars
UrbanCars is a domain-specific benchmark using artificially composited images with deliberately planted shortcuts (backgrounds and co-occurring objects). Reliably manipulating these shortcuts requires access to the compositing elements, which our general-purpose VLM and diffusion editor are not designed for. Evaluating UrbanCars would therefore require domain-specific editing or re-compositing. Our new joint-removal experiment (W1.2) directly examines interacting shortcuts in PROBE's intended natural-image setting. We clarify this scope in App. G.1.
Q4 — Do SCORE's conclusions hold after fidelity filtering?
Yes. To isolate the effect of fidelity filtering, we added a new controlled comparison using the same 78 classes as the filtered evaluation in Table 25. We re-scored these classes without filtering, so the only difference between the two evaluations is the removal of flagged renders.
Filtering preserves the classifier pairs defining the extremes of all three SCORE rankings. The confidence-shift and shortcut-stress gaps remain essentially unchanged, while the object-only accuracy gap increases after removing renders with missing target objects. The differences between the original 99-class evaluation and the 78-class evaluation also reflect changes in class composition, which this controlled comparison eliminates.
The new results are reported in App. Table 26.
Thank you for the detailed rebuttal. However, my main concerns remain partially unresolved.
DISCOVER reliability: Given the low Jaccard similarity (0.128) between editors, how stable are the discovered spurious-cue inventories? The 93.3% agreement is limited to cues verified by both editors.
SCORE validity: While I understand that SCORE is not intended to directly measure real-image robustness, the near-zero correlation (−0.05) on Waterbirds raises questions about its reliability for cross-architecture comparisons. Could the authors further clarify what supports such comparisons?
Response to Reviewer HiUr (1/2)
W1.1 — Reliability of counterfactual edits
DISCOVER uses automatic checks to reduce unreliable edits: a near-identity gate rejects ineffective edits, and the VLM examines the original and edited images when assigning categories. While individual edits are not human-verified, we validate the resulting cue inventories against independent annotations. DISCOVER recovers 84% of Salient ImageNet's reference cues, correctly places the documented spurious cues of all 10 applicable Hard ImageNet classes in the spurious category, and identifies labeled contexts for 55 of 60 NICO++ categories (Sec. 4.2).
We additionally test whether the decisions depend on the image editor. Replacing FLUX with InstructPix2Pix yields 93% agreement (126/135) on cues verified by both editors (App. G.17). Together, these results provide complementary evidence for the reliability of DISCOVER's outputs, beyond any individual editing model.
W1.2 — Testing each cue alone may miss interacting or redundant shortcuts
We agree that testing cues individually may miss dependencies that only emerge when multiple shortcuts are removed together. To investigate this, we added a joint-removal experiment in which all discovered contextual cues are removed simultaneously for each of the 100 classes (new table is added to App. G.18).
Across five classifiers, joint removal reveals only 0–3 additional classes per classifier in which the confidence change exceeds the threshold but no individual cue removal does. Thus, in nearly all cases where joint removal reveals a dependency, at least one individual cue already produces a measurable effect.
Furthermore, SCORE evaluates combinations of contextual cues rather than isolated cues, allowing it to measure their combined influence on classifier predictions. These results suggest that individual cue testing captures most dependencies detectable through joint removal in our experiments.
W2.1 — Reliability of SCORE's shortcut-reliance metrics
SCORE measures classifiers' responses to discovered visual cues, rather than serving as a direct measure of real-image robustness. We provide three complementary experiments supporting its sensitivity to classifier behavior.
First, on Waterbirds, we evaluate the same ResNet-50 backbone before and after two debiasing interventions (DFR and GroupDRO), using identical probes. Both interventions improve real-image worst-group accuracy (from 0.751 to 0.908 and 0.858, respectively), while SCORE's confidence shift and shortcut-stress accuracy move in the expected directions (Sec. 4.3).
Second, an untrained ResNet-50 produces no substantive cue findings and near-chance probe accuracy, indicating that the generative pipeline alone does not produce the observed results.
Third, our additional evaluation on real Spurious ImageNet photographs shows an association with SCORE confidence shift in the expected direction, providing complementary evidence from a real-image benchmark (new App. G.19).
Together, these experiments support SCORE's ability to detect shortcut-related changes in classifier behavior. We clarify in Sec. 4.3 that confidence shift is primarily interpreted within model families, rather than as a calibrated measure of robustness across architectures.
W2.2 — Generation errors in SCORE probes
We acknowledge these fidelity issues and explicitly report the VLM grader's findings: the target is flagged as present in 10% of context-only probes and absent in 27% of object-only probes (App. G.12). Target leakage can inflate context-only accuracy, which we therefore interpret as an upper bound on genuine context-only recognition. Conversely, missing targets can underestimate object-only accuracy.
We also evaluate the impact of these errors directly. Fidelity filtering substantially reduces context-only accuracy, while preserving the classifier pairs defining the extremes of all three SCORE rankings when the evaluated classes are held fixed (App. Table 25 and new Table 26). We discuss this controlled comparison further in Q4.