- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper argues we should interpret concept discovery measurements compared to an untrained encoder, not on their own. The score of an untrained encoder can be measured by using randomly initialized parameters. The paper decomposes the score of the random encoder into estimator bias and concept information. The quantity of interest is concept information, and the estimator bias can be largely removed by AMI. In terms of the margin over an untrained encoder, level 1 methods that don't use concept labels show marginal gain. However, CBM, which uses concept labels, shows a larger gain. The paper proposes ConceptDiscoveryBench, which is a tabular benchmark with the score of an untrained encoder.
Critical strengths
- The argument of comparing the score with the untrained encoder is valid. The decomposition of the current measurement into components supports this argument by showing that part of the untrained encoder's score cannot be removed by existing corrections such as AMI.
- The paper provides ConceptDiscoveryBench, which contains the score of the untrained encoder that the paper recommends. This enables future work to compare its scores to the untrained encoder without evaluating it.
Critical weaknesses
- The paper lacks novelty. The main argument of comparing the performance against an untrained encoder is valid. However, it provides limited new insights beyond previous work. As the paper already mentioned, previous work also compared to the untrained encoder, which takes away from the paper's contribution.
- The paper is really hard to read, so it should be reorganized to be published. The main content of the paper contains too much technical detail, including the file names, scores, and settings, which can be sufficiently explained in the appendices. The main content repeatedly explains what the paper changed from the previous version.
Questions for authors
Please see the weaknesses.