- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
Spurious correlations is one of my most favorite and simple topics that can be easily understood. This paper tries to understand when in the presence of spurious features/cues, the model starts to escape from them and how and why does this escape vary across architectures.
Critical strengths
None. This is one of the most poorly written papers I have ever read - both technically and grammatically.
Critical weaknesses
- This is one of the most extremely poorly written paper that I have ever read on spurious correlations from the abstract till the Conclusion. Almost all the sections in this paper have technical issues in them. I put below several such examples of them directly from the paper (I rarely say this but it seems like to me that the authors have used AI tools for writing the whole paper without even proof-reading what they have written even though they say they have proof-read all the AI assisted content in their AI Use Statement section):
- Fig 1 says that in early checkpoints, shortcut usage dominates. However, in Fig 2 for all 3 models, we can clearly see that in early checkpoints both shortcut (orange line) and core usage (blue line) are almost the same. This is completely conflicting. Moreover, Fig 1 is only reported for 1 seed even though the authors say they ran 5 seeds. I don't see any figures showing other seeds results.
- Line 104 is so convoluted to even understand the digit-color task considered in this study.
- There is no clarity regarding how P_align, P_swap, A(t) and C(t) are calculated in the main paper when they are originally introduced in line 129. Appendix B.1 tries to explain them but they are still never defined and explained how to even compute them. This is a major technical limitation given the authors base their paper's conclusions on these terms.
- Line 136 says "main reliability sweep" but never even defines what it actually means. Moreover, in the same paragraph, the observation that they make by saying as increases (I believe here refers to the probability spurious feature appears in train set - also very difficult to understand in one-go), spurious features reliance increases, is a well-known fact from several prior works [1,2] and nothing is new about it.
- In line 148, the authors say - "Reliability changes the opportunity to recover". This line does not even make any sense. I don't even think it is even a complete sentence, given the context in which they use the word "reliability".
- In line 161, the authors introduce a new term called "Shallow-MM" but never defined it beforehand. I still don't understand what they even mean by it.
- I don't even understand what Section 3 even tries to tell for the paper. For instance, what are: "logit allegiances", "two route model", "shortcut and core product margins", "U", "V", as defined in lines 216, 247-249. There many more such technical terms which are never defined in Section 3. Moreover, all the theoretical equations read like they are just forcefully added to the section to make it even more convoluted.
- CKA similarity experiment discussed in Section 4 never explains why Tiny-ViT experiences later escaping from spurious cues compared to U-Net and ResNet18. It has never been casually explained in the paper.
- Section 5 says that it is extended spurious cues to other modalities but the tasks for the new modalities are also never explained properly. I can't understand anything what the authors are even trying to say from this section.
- Discussion and Conclusion sections read like broken sentences without ever summarizing the core contributions of the paper.
-
Apart from the above mentioned technical issues in the paper (they are many more - I have listed as much as I can within my timeframe), the paper fails to even consider widely used spurious correlations dataset called - WaterBirds, CelebA, MNLI, HardImageNet. The authors should instead consider these datasets before even jumping to other new modalities in generative tasks.
-
The authors say that Tiny-ViT observe late onset of escape compared to ResNet18 and U-Net. However, this is just an incomplete analysis to make any claim. The results should be verified for atleast 4-5 transformers (vision and language both) and 4-5 non-transformers models like ResNet, VGGNet, U-Net, DensNet. Also all transformer and non-transformer set of models should consist of multiple sizes to see if the trend is fixated to a particular size or any particular trend emerges among model sizes.
[1] Last layer re-training is sufficient for robustness to spurious correlations.
[2] Spurious Correlations in Machine Learning: A Survey
Questions for authors
Please see Weaknesses
Overall I believe the paper needs a major revision from basic thinking, technical, and writing perspectives before it can be submitted to any conference in the future, and I don't think any form of revision will help them improve their chances for the current conference submission. I hope the authors can significantly improve their paper based on the feedback provided. In the current stage I am not willing to accept it. (PS: I have not used any AI tool to review your paper).