- Rating
- 1
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes SECMVC, a contrastive multi-view clustering method that utilizes multimodal large language models (MLLM) to provide semantic supervision. This method constructs semantic anchors through a small number of MLLM queries, and adopts prototype learning and query-guided contrastive learning respectively based on the reliability of the samples. The authors conducted experiments on four multimodal datasets and reported superior results compared to traditional multi-view clustering methods.
Critical strengths
The overall structure of the paper is clear, and the description of the methods and experiments is relatively complete.
Critical weaknesses
- The practical significance of the research question and the necessity of the methods are insufficient. With the development of multimodal large models, many traditional multimodal clustering tasks can now be directly solved by the semantic understanding capabilities of pre-trained models. Although this paper introduces MLLM, it still builds a complex framework around traditional feature alignment, prototype learning, and contrastive clustering. The authors do not adequately explain what this framework actually solves, compared to directly using large models for semantic classification or clustering. This is an important issue that cannot be simply replaced by simple methods, and it is still crucial. Therefore, I have significant doubts about the practical value and research significance of this work.
- There is a lack of key large model baselines, and the experimental persuasiveness is insufficient. The 18 baselines compared in the paper did not use MLLM, while the proposed method can utilize MLLM to obtain additional semantic information. Such a comparison cannot distinguish whether the performance improvement comes from the large model itself or from the proposed clustering algorithm. In particular, there is a lack of comparisons that directly use MLLM, MLLLM to generate pseudo-labels, and modern multimodal semantic embeddings combined with simple clustering algorithms. This makes the significant performance improvement reported in the paper difficult to fully prove the independent value of the method.
Questions for authors
- Given that multimodal large models already possess strong semantic understanding capabilities, the author asks: Compared to directly using MLLM for semantic classification or clustering, what are the irreplaceable advantages of SECMVC? Are there any practical application scenarios that can only be addressed by relying on the proposed framework?
- If under the same MLLM query budget, using MLLM to generate pseudo-labels and combining simple label propagation or K-means, how would the performance be? How do the current experiments prove that the performance improvement comes from the proposed clustering mechanism rather than the semantic understanding ability of MLLM itself?