- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper provides a new bias-label free method to train models under spurious correlations, outperforming ERM and several anootation-free two-stage methods and also methods that utilize annotations. The propsoed method, SAS, focuses on subspace learned by the feature encoder, and updates/regularizes the classifier weights after each gradient step and outputs a debiased classifier.
Critical strengths
- This paper proposes a cheap alternative to methods on mitigating spurious correlations that rely on bias labels that are hard to obtain in practice, and two-stage methods that require twice the training time as ERM methods. The propose algorithm requires one extra step after each gradient step, which applies SVD on the centered batch features with small additional cost. The paper is also well written and very easy to follow.
Critical weaknesses
- Various works separate the feature encoder and the classifier head and specifically focus on the features fed to the classifier head and/or modify the classifier weights to mitigate spurious correlations. The two most obvious works are DFR [1] and AFR [2], but there are many others one can find by looking through the papers that have cited these two. This family of works requires its own subsection under Related Works and comparisons in the Experiments section. In its current form, SAS is compared against only two works (LfF and JTT) from 2020 and 2021, respectively. A more comprehensive and detailed literature review and comparison against annotation-free methods should be presented. Furthermore, the paper identifies multiple spurious cues as an important problem but evaluates its method on relatively easy datasets such as Biased-MNIST. I wonder if the proposed annotation method could achieve high accuracy on harder datasets such as UrbanCars. One less significant comment I have is: why do the authors use Unbiased Accuracy (UA) instead of the commonly used Worst Group Accuracy (WGA)?
- The idea and the proposed direction itself have been studied for a while now (see above). Many studies have linked the problem of mitigating spurious correlations to the simplicity bias phenomenon, where the model learns easy features (spurious features) before learning more structured, complex features (core features). From my perspective, splitting the model into the feature encoder and the classifier head, and then performing several operations to align the outputs of the feature encoders or modify the classifier heads, are all very similar approaches. The novelty claims of this paper would significantly benefit from comparisons against similar methods and, again, more generally, annotation-free methods that have been published since 2021.
[1] Kirichenko, Polina, Pavel Izmailov, and Andrew Gordon Wilson. "Last layer re-training is sufficient for robustness to spurious correlations." arXiv preprint arXiv:2204.02937 (2022).
[2] Qiu, Shikai, et al. "Simple and fast group robustness by automatic feature reweighting." International Conference on Machine Learning. PMLR, 2023.
Questions for authors
See the Critical Weaknesses section. My major concerns are regarding the novelty of the proposed approach, apart from a few small components, such as the use of the cosine classifier. The given problem is well studied in the literature, and similar methods have been proposed but have been neglected in the literature review and experiments. Can the authors present a more comprehensive literature review and provide experimental analysis against other annotation-free methods, specifically focusing on methods that split the model into a feature encoder and a classifier head?
4 comments
simplicity bias, recent baselines, UrbanCars, WGA
Simplicity bias. We agree this is the right way to look at it, and the revision will discuss it explicitly. Easy spurious features are learned first and dominate the top of the spectrum, and SAS caps how much the head relies on those directions so that weight moves to the rest. We measured head energy in the top- subspace against a cosine-only model with the same head (3 seeds). It goes from 0.42 to 0.20 on Biased-MNIST, from 0.98 to 0.84 on CelebA and from 0.44 to 0.33 on COCO.
More recent annotation-free baselines. In addition to JTT and LfF, we ran Spectral Decoupling (the closest single-stage remedy for simplicity bias), BSP and FLAC-B, with the same backbone, epoch budget and checkpoint rule as SAS (3 seeds). Biased-MNIST reports unbiased accuracy and CelebA/COCO report UA. Each baseline is shown with the better of the two / values we tried.
| MNIST q=.90 | q=.95 | q=.99 | CelebA | COCO | |
|---|---|---|---|---|---|
| SAS | 88.85 | 69.80 | 34.32 | 93.59 | 83.50 |
| Spectral Decoupling | 86.87 | 53.78 | 25.11 | 92.98 | 83.77 |
| FLAC-B | 80.43 | 57.16 | 36.04 | 94.36 | 81.65 |
| BSP | 90.44 | 76.97 | 42.03 | 93.26 | 83.32 |
SAS is clearly ahead of Spectral Decoupling on Biased-MNIST (+2.0 / +16.0 / +9.2 points) and on CelebA, and on COCO the two are within one standard deviation. Against FLAC-B, SAS is ahead on Biased-MNIST (q ≤ 0.95) and on COCO. FLAC-B does better on CelebA and BSP on Biased-MNIST, and we will list both as limitations. BSP regularizes the encoder spectrum while SAS constrains the head, so the two could be combined. The related-work section will also cover uLA, SELF, DeFund and SPARE.
UrbanCars. Biased-MNIST is our controlled benchmark with two bias attributes. The main evidence is CelebA and MS-COCO (ResNet-18, two candidate biases each), plus ViT-S/B on COCO (App. K.10). We couldn't finish UrbanCars within the discussion period and will add it to the revision.
UA vs. WGA. We used UA (accuracy averaged uniformly over label × bias cells) because it is the standard metric of the multi-bias protocol we follow (BC-BB, FLAC, GMBM), which let us reuse its setup and baselines. We agree that WGA is stricter and more widely used, so we now report it over all intersectional groups with at least 20 test images. SAS gets 70.67±1.89 on CelebA and 68.83±3.81 on COCO; AFR and DFR are in Part 1, and the group counts are in our reply to Reviewer LdBy. The smallest COCO groups included have only 32–36 test images, so COCO WGA moves by about 3 points per image. The revision will report WGA for every method.
In short, we added a direct comparison with feature–head methods (DFR, AFR) and with three more annotation-free and spectral baselines (Spectral Decoupling, BSP, FLAC-B). We also stated the novelty more clearly: a leverage-selected head update with provable alignment reduction, applied in a single training run. We hope this addresses your concerns about positioning and novelty, and we would be grateful if you would consider raising your score.
Thanks for the response, I will go over it in detail. Quick note on this:
First , Thank you for the positive comments on clarity and soundness, and for the pointers to related work. We can't update the PDF during the discussion, so the new results are below; the related-work section and these comparisons will be added in the revision.
ICLR allows the uploaded PDF to be updated during the rebuttal period, so I do not understand why you state "We can't update the PDF during the discussion".
Thank you for pointing this out, and sorry for the confusion. When we wrote the response, we did not know the PDF could be updated during the discussion period. We have now uploaded a revised PDF, with all new or changed text in blue. Everything promised in our response is now in the paper:
- Related work on feature–head methods (DFR, AFR, SELF), spectral and simplicity-bias regularizers (Spectral Decoupling, BSP, DeFund) and recent annotation-free methods (uLA, SPARE): Sec. 2, with an extended version in App. N.
- Comparison with AFR and DFR, including worst-group accuracy: App. M.4, Table 26. The intersectional group counts are in Table 27.
- Spectral Decoupling, BSP and FLAC-B under the same protocol: App. M.3, Table 25.
- Simplicity-bias view and head-energy measurements: App. N and App. M.5, Table 28.
- Novelty / analysis: the alignment results are summarized in Sec. 3.5 and proved in App. E.5 (Props. E.5–E.7). Coordinate selection is compared with whole-subspace attenuation in App. M.2, Table 24.
- UrbanCars is listed as limitation (4) in App. A.
We would be glad to hear any further comments.
Feature–Head Methods (DFR, AFR) and Novelty
First , Thank you for the positive comments on clarity and soundness, and for the pointers to related work. We can't update the PDF during the discussion, so the new results are below; the related-work section and these comparisons will be added in the revision.
How SAS differs from DFR and AFR. DFR retrains the last layer on a group-balanced held-out set, so it needs group labels. AFR retrains the last layer on held-out data, with weights computed from a first-stage ERM model. Both are post-hoc, two-stage methods: they work on frozen ERM features and need a held-out split. SAS runs in a single stage during training, so the encoder adapts to the constrained head. CKA between ERM and SAS is 0.82 in early-to-mid layers but 0.48 in the deepest layers. SAS also needs no held-out data, no reweighting and no auxiliary model.
We compared them directly (3 seeds). For AFR and DFR, the ERM features are trained on 80% of the training set, and the other 20% is used for retraining and selection. SAS is our rerun in the same pipeline, which is close to the paper's numbers.
With the same label budget (no group labels), SAS is above AFR on all four metrics, using one training run. DFR uses group labels and, as expected, has much higher CelebA WGA, although its COCO UA is below SAS.
Novelty. We agree that splitting encoder and head is not new in itself. Our contribution is a specific mechanism that can be analyzed: leverage scores of the batch's dominant right-singular subspace decide which head coordinates to attenuate during training. The revision adds three results that make this concrete, with P the top-k projector, M the selection mask and D=I−(1−α)M:
The experiments support each part. Selecting the same number of random coordinates does not reduce alignment: head energy in the top-16 subspace on COCO is 0.90 for random selection and 0.33 for SAS. Attenuating the whole subspace instead is worse than SAS in all five settings (on Biased-MNIST, 87.98 / 64.57 / 30.85 vs. 88.85 / 69.80 / 34.32), and hard removal sends CelebA and COCO to chance. DFR, AFR and other last-layer methods have no counterpart to this mechanism or these guarantees.