- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper focuses on the zero-shot classification robustness of CLIP under common image corruptions, where the goal is to maintain accuracy on corrupted images without task-specific labels. To address this issue, the authors proposed AnchorCLIP, a lightweight adapter framework with frozen CLIP encoders. AnchorCLIP is trained once on clean images with synthetic corruptions and uses intermediate-layer class tokens, a concept dictionary, and interpretability-based losses to align corrupted-image embeddings with clean semantic concepts. The authors validated the method on CIFAR-10C, CIFAR-100C, and ImageNet-C, and the results showed that AnchorCLIP achieved higher accuracy than CLIP, TeCoA, and FARE under most corruptions while largely preserving clean-image performance.
Critical strengths
-
The method design is practical. It freezes both CLIP encoders and trains only a lightweight adapter. Inference needs a single forward pass, with no clean reference image and no test-time optimization, so it avoids full-encoder fine-tuning and TTA overhead and is easy to plug into existing CLIP pipelines.
-
The paper reports a useful negative result. In the supplementary experiments, SpLiCE and COLA both have lower accuracy than CLIP under common corruptions, showing that these concept/subspace methods do not transfer directly to corruption settings. This is a useful reference for future work on semantic constraints.
Critical weaknesses
-
The robustness comparison is not well aligned with the task. The main robustness baselines, TeCoA and FARE, are trained for adversarial attacks rather than common corruptions. Reporting corruption accuracy therefore shows only transfer, not a direct comparison under the same threat model. As a result, the results do not establish competitiveness against corruption-specific methods.
-
The interpretability claim is not sufficiently supported. The paper offers only qualitative concept visualizations, with no faithfulness or intervention tests. even in Figure 8, a boot image yields “jewelry”. Thus, “inherently explainable” and “not a Black Box” lack support.
-
Table 14 compares only two single losses and two symmetric mixtures (0.7/0.3 and 0.3/0.7), with no 0.5/0.5 or finer grid, and reports results on only four corruptions of CIFAR-100-C. It therefore shows only that the two losses work better together, not that 0.7/0.3 is an optimal or robust weighting.
Questions for authors
See the Critical Weaknesses
The authors provided no rebuttal. So I maintain my original score.