- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes S³, a unified framework for text-assisted image clustering that addresses the challenges posed by imperfect image-text alignment and semantic noise. First, coordinate descent is employed to select K texts from WordNet candidates that yield better clustering predictions. Second, a combination of shared loss functions and the FSO loss is used to optimize image cluster assignments. Experiments on seven datasets demonstrate the effectiveness of the proposed method.
Critical strengths
- This paper transforms the traditional two-stage TIC framework into an end-to-end optimization framework.
- Experimental results demonstrate that S³ identifies more suitable text features to improve image clustering performance.
- The performance improvement on Tiny-ImageNet is particularly significant.
Critical weaknesses
- Numerous existing methods, such as SIC, TAC, GradNorm, CAE, SEIC, and DRSC, have already explored how to better leverage WordNet or textual features generated by LLMs to improve image clustering performance. Moreover, the proposed method appears to be primarily a combination of existing components. Therefore, the novelty of the proposed method appears limited.
- Compared with existing methods that more thoroughly exploit WordNet, the proposed method does not demonstrate clear advantages in either computational efficiency or clustering performance.
- The theoretical analysis does not adequately support the central scientific claims of the paper. Instead, it primarily focuses on the optimization properties of the proposed method.
- The paper only reports runtime results on the DTD dataset without comparisons against other closely related methods. Moreover, the reported computational cost on DTD alone is already substantial, with most of the runtime consumed by Stage 2.
- The paper reports a remarkably large performance improvement on Tiny-ImageNet, but does not provide a sufficiently convincing analysis of the factors contributing to this improvement.
- Could the authors report the clustering performance and runtime of the proposed method on ImageNet-1K?
Questions for authors
Please see the Weaknesses.