- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work introduces an extension of standard supervised contrastive learning framework called TaxoCon.
The proposed TaxoCon uses a stop-gradient EMA to estimate within-class pairwise similarity and redistribute positive-pair attraction.
Without requiring the finegrained labels, the proposed model is able to assign higher learning pressure to similar positives.
The evaluations are performed on two datasets, covering 3 pretrained backbones. They show improved performance.
Critical strengths
-
The evaluations show clear improvements compared to existing works on two benchmarks.
-
The organisation of the paper is clear and clean.
Critical weaknesses
Major:
-
The novelty of this work appears to be limited. It sounds more like an extension of existing supervised contrastive learning framework. Fig 1 and fig 2 are quite poorly presented. It does not show what are the key innovations and how this work differs from existing works.
-
The evaluations appear to be very limited. (i) The authors should explore more pretrained models in the literature, only 3 pretrained models presented in the paper showing improvements appear to be cherry picking and biased. (ii) The evaluations should be performed on more challenging datasets. In addition, large scale evaluations and comparisons are need to show the wide applicable of the proposed framework.
-
Most experimental results are presented in the form of tables, and there are no enough figures/plots to show why and how the proposed framework works compared to existing methods/frameworks in the current literature.
-
The method section does not provide proper justifications of why choosing these blocks/modules, what are the design principles, etc, and how each component contributes to what tasks/purposes etc. After reading the method section several times, I could not figure out what are the key innovations of this work. In addition, it is unclear to me what are the losses used for training and for downstreaming tasks etc.
-
Sec 4.4 could be much clearer. In additon, the variants of the proposed framework could be clearer in the method section, and why those variants, how each variant contributes to the improvements.
-
I feel the current evaluations and comparisons are not thorough enough.
Minor:
-
Figure font sizes are too small to read, eg, fig 1.
-
Some redundant parts presented in the paper due to the use of eg "overall", etc.
Questions for authors
Refer to my raised concerns.