- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The authors show that the choice of pre-trained image encoding model is an important factor in the success of a downstream classifier.
Critical strengths
- Careful experimental validation of the hypothesis (that the choice of pre-trained image encoding model is an important factor in the success of a downstream classifier).
- Introduces a practical workflow to help researchers choose a pre-trained image encoder.
Critical weaknesses
- The fact that the choice of image encoder has a high impact on downstream predictive models has been a central tenant in computer vision since the beginning of the field. The revolution of general pre-trained encoders may have led newer researchers to believe that visual encoding was a solved problem, and so it is good for them to be reminded that there is (at least not yet) one encoder that rules them all.
- The paper cites several recent papers making similar arguments. Some that are missing include Goldblum et al. (2023), "Battle of the Backbones," and Ericsson et al. (CVPR 2021), "How Well Do Self-Supervised Models Transfer?".
Questions for authors
Could you consider adding to the evaluation some models that practitioners would be most likely to use. For example, for medical images there is RAD-DINO or CheXzero. It would be nice to also include the original CLIP (although one would not expect it to be as strong as the others, it is still widely used).