- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper is motivated by the limitations of existing bias-mitigation methods of enforcing global bias invariance. The authors instead propose CMDR that enforces conditional minimal sufficiency. At the objective level, the authors use two additional regularizers: target-conditioned debiasing using a discriminator and variational conditional minimality regularization.
Critical strengths
- Principled theoretical motivation. The paper provides a clear information-theoretic motivation for target-conditioned debiasing, highlighting the incompatibility between global bias invariance and target sufficiency when target and bias variables are statistically dependent.
- Flexibility in bias supervision. The framework supports both explicit bias annotations and confidence-weighted pseudo-bias supervision, making it applicable to settings where training-time bias labels are unavailable.
Critical weaknesses
- Missing comparisons with recent baselines. The evaluation omits competitive methods such as DPE (ICML 2025) and SCER (ICLR 2026), which report higher worst-group accuracy on some overlapping benchmarks. Although evaluation protocols differ, their omission weakens the evidence for CMDR's competitiveness against recent methods.
- While the experiments employ shared CLIP backbones where applicable, CMDR-Pseudo additionally leverages pretrained CLIP ViT-L/14 representations to generate pseudo-bias supervision. This may provide an advantage over baselines that do not use equivalent auxiliary pretrained features, making the comparison unfair.
- Limited evaluation of multi-bias robustness and large-scale generalization. The experiments focus primarily on datasets involving a single explicitly modeled bias attribute and relatively few target classes. Although the appendix examines robustness to several additional attributes on CelebA, this does not constitute a systematic evaluation of simultaneous multi-bias mitigation. Furthermore, the paper does not evaluate large-scale datasets such as ImageNet-1K or associated distribution-shift benchmarks. Recent methods such as SEBRA (ICLR 2025) investigate these more challenging settings. Consequently, it remains unclear how well CMDR scales to large numbers of classes and multiple interacting spurious correlations.
- Although the related-work section categorizes existing debiasing approaches and briefly describes CMDR's intended differences, it provides limited critical comparison with closely related conditional adversarial representation-learning methods. In particular, the manuscript does not sufficiently explain which aspects of the proposed formulation and implementation are genuinely new relative to earlier conditional debiasing approaches.
- Limited novelty of the conditional adversarial debiasing component. The central idea of minimizing representation–bias dependence conditioned on the target, (I(H;Z_b\mid Y)), has substantial prior art. In particular, [1] and [2] already investigate conditional adversarial approaches to suppressing bias information while preserving target-relevant features. The current manuscript does not sufficiently distinguish its conditional debiasing component from these existing approaches.
[1] Conditional Learning of Fair Representations, ICLR 2020 [2] Conditional Adversarial Debiasing: Towards Learning Unbiased Classifiers from Biased Data
Questions for authors
- How do the proposed methods scale to a dataset with multiple biases and a large number of classes?
5 comments
W2: Fairness of the Pretrained Backbone Comparison
We thank the reviewer for raising this important concern. We agree that ensuring fair experimental comparisons is essential. However, we would like to clarify that under the CLIP ViT-L/14 experimental setting, all reproduced baselines use the same pretrained CLIP ViT-L/14 backbone. Therefore, CMDR-Pseudo is not the only method that benefits from this pretrained representation.
The distinction is that CMDR-Pseudo additionally leverages frozen pretrained features to construct pseudo-bias supervision, rather than relying on an exclusively available source of pretrained knowledge.
More importantly, Appendix I already investigates the potential advantage introduced by using ViT-L/14 as the pseudo-bias extractor through a backbone replacement experiment. Specifically, we keep the debiased model fixed as CLIP ResNet-50 and replace only the pseudo-bias extractor, while maintaining the remaining experimental configuration.
Table R3. Effect of pseudo-bias extractor choice (Appendix I, %).
| Pseudo-Bias Extractor | Waterbirds WGA↑ | Waterbirds Avg↑ | CelebA WGA↑ | CelebA Avg↑ |
|---|---|---|---|---|
| CLIP ViT-L/14 | 70.405 | 93.483 | 77.778 | 96.035 |
| CLIP ResNet-50 | 71.028 | 91.949 | 75.786 | 95.437 |
Note: The debiased model uses CLIP ResNet-50 in both configurations.
The results show that replacing the ViT-L/14 pseudo-bias extractor with ResNet-50 improves Waterbirds WGA by 0.623 percentage points, while CelebA WGA decreases by only 1.992 percentage points. Moreover, both configurations maintain higher WGA than the other baselines without training-time subgroup supervision under the same debiased backbone setting.
These findings suggest that CMDR-Pseudo's performance gains cannot be simply attributed to the additional use of a stronger ViT-L/14 pretrained model, but are closely associated with the proposed pseudo-bias supervision and conditional debiasing mechanisms.
We also acknowledge that pseudo-bias discovery involves additional feature processing. We will therefore clarify the associated computational overhead in the revised manuscript to improve the transparency of our experimental comparisons.
W3: Multi-Bias Robustness and Large-Scale Generalization
We thank the reviewer for this valuable suggestion. We agree that robustness to multiple biases and generalization to large-scale datasets are important directions for evaluating debiasing methods.
Our experiments follow widely adopted benchmarks and evaluation settings in the debiasing literature, including those used by LfF (NeurIPS 2020), JTT (ICML 2021), BE (AAAI 2023), BM (CVPR 2023), GroupDRO (ICLR 2020), DFR (ICLR 2023), CFR (CVPR 2024), TAB (ECCV 2024), NSF (CVPR 2025), TTR (ICCV 2025), AGS (ICLR 2026), Hierarchical DRO (ICLR 2026), and Zero-Shot CLIP (ICML 2021). Appendix J further includes experimental comparisons with DeNetDM (NeurIPS 2024), GERNE (ICCV 2025), and SEBRA (ICLR 2025).
We acknowledge that we have not yet evaluated CMDR on ImageNet-1K, which contains 1,000 categories and 1,281,167 training images. Nevertheless, we have conducted extensive evaluations on five datasets with diverse types of spurious correlations: Waterbirds, CelebA, BAR, MetaShift, and BFFHQ, including CelebA with 202,599 images.
It is worth noting that SEBRA (ICLR 2025) primarily evaluates on UrbanCars, CelebA, BAR, MultiNLI, and ImageNet-1K. Among these datasets, CelebA and BAR overlap with our evaluation benchmarks, and we have already included additional comparisons with SEBRA under a unified experimental setting in Appendix J. We appreciate the reviewer's suggestion regarding ImageNet-1K and plan to extend our evaluations to larger-scale datasets in future work.
Furthermore, CMDR's theoretical framework is not inherently restricted to a single bias attribute or binary classification. For multiple bias attributes, they can be jointly represented as a multidimensional variable,
allowing target-conditioned adversarial learning to suppress conditional dependence between the learned representation and the joint bias variable. Meanwhile, conditional minimality provides an additional regularization objective for reducing residual nuisance information that is not explicitly modeled. When bias semantics or training-time bias annotations are unavailable, CMDR-Pseudo can further provide weak supervisory signals through pseudo-bias discovery.
Our existing experiments also provide preliminary evidence of robustness to multiple potential biases. Specifically, Appendix L evaluates four additional attributes on CelebA—Black Hair, Heavy Makeup, Smiling, and Straight Hair—that were not explicitly used as bias attributes during training. CMDR achieves higher worst-group accuracy than ERM for all four attributes, without showing clear evidence of bias transfer in these evaluations.
Although these results do not constitute a systematic evaluation of simultaneous multi-bias removal, they suggest that CMDR has the potential to extend to settings involving multiple latent biases.
W1: Comparisons with Recent State-of-the-Art Methods
We thank the reviewer for this valuable suggestion. We agree that comprehensive comparisons with recent state-of-the-art methods are important. However, we would like to clarify that our manuscript already includes comparisons with several recent methods published in 2025 and 2026. Specifically, Tables 1–2 compare CMDR with NSF (CVPR 2025), TTR (ICCV 2025), AGS (ICLR 2026), and Hierarchical DRO (ICLR 2026). Appendix J further provides comparisons with DeNetDM (NeurIPS 2024), GERNE (ICCV 2025), and SEBRA (ICLR 2025). Thus, our existing evaluation already covers multiple representative recent approaches, rather than lacking comparisons with contemporary methods.
To directly address the reviewer's suggestion regarding DPE (ICML 2025) and SCER (ICLR 2026), we additionally reproduced these methods on Waterbirds and CelebA using CLIP ResNet-50 and ViT-L/14 backbones. We organize the comparisons according to the availability of training-time subgroup supervision, comparing DPE with CMDR-Pseudo and SCER with CMDR-Bias, respectively.
Table R1. Comparison with DPE and SCER on Waterbirds (%).
Table R2. Comparison with DPE and SCER on CelebA (%).
Note: Results are reported in percentages. Bold values highlight the higher WGA within each supervision setting. DPE and SCER results are from our additional reproductions, whereas CMDR results are from Table 1 of the manuscript.
These additional experiments further support the competitiveness of CMDR: across both datasets and backbone architectures, CMDR-Pseudo consistently achieves higher WGA than DPE, while CMDR-Bias consistently outperforms SCER in WGA. Although average accuracy varies across methods and some WGA improvements are relatively small, these findings provide additional empirical evidence of CMDR's competitiveness against recent approaches. We will incorporate these comparisons into the revised manuscript and further clarify the supervision requirements and experimental protocols of the respective methods.