- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Bridged Clustering, a semi-supervised method that independently clusters unpaired inputs and outputs and uses a small paired set to align the clusters. Predictions are obtained by assigning an input to a cluster and returning the centroid of its corresponding output cluster, with soft-bridging and regression-based variants for less structured settings. Experiments on four multimodal datasets show strong performance on BIOSCAN, COCO, and Flickr30k, but weaker results on WIT. The paper also relates performance to clustering and bridging errors.
Critical strengths
-
Bridged Clustering addresses a meaningful limitation of conventional semi-supervised learning by using independently available outputs. Its combination of separate clustering, sparse cluster alignment, and centroid prediction is computationally lightweight, model-agnostic, and easy to inspect. The soft-bridging and cluster-wise regression variants also provide natural extensions for imperfect clustering and within-cluster variation.
-
The paper evaluates four multimodal datasets, both prediction directions, inductive and transductive settings, multiple supervision levels, and several adverse conditions. The use of 30 randomized trials per configuration and the analysis of cluster quality, bridge accuracy, overlapping categories, misspecified cluster counts, and larger cluster numbers provide useful evidence about when the method succeeds or fails.
Critical weaknesses
-
The experimental construction strongly favors the method’s assumptions and uses unavailable latent information. The experiments provide one to four supervised examples per ground-truth cluster, guaranteeing that every cluster can be bridged. The datasets are also curated into balanced and relatively separable categories, while constrained k-means and the voting procedure were selected using AMI and ground-truth latent associations. WIT and Flickr30k categories are partly constructed from text features related to the evaluated output representations. These choices make it unclear whether the method would work with randomly sampled pairs and genuinely independent, imbalanced, or partially mismatched datasets.
-
The theory and evaluation do not fully support the paper’s broad prediction claims. The theoretical section provides an existing misclustering bound and an informal majority-vote argument, but no finite-sample bridge-error or end-to-end prediction-risk guarantee. Empirically, the method predicts pretrained embedding centroids rather than actual images, captions, or sequences, and the multimodal datasets are made “unpaired” by hiding correspondences from originally paired data. The results therefore demonstrate latent-space cluster imputation under favorable conditions more convincingly than general prediction between independently collected modalities.
Questions for authors
-
How would Bridged Clustering handle an input cluster for which the randomly sampled paired set contains no examples? Can you report results when the paired samples are drawn globally, without guaranteeing one or more examples per latent cluster?
-
How much of the performance comes from the pretrained representation models? What happens with weaker, domain-shifted, self-supervised, or randomly initialized representations?
Dear reviewers, We value your time and thoughtful comments, which we addressed with the utmost respect. We have invested significant effort to answer your questions and check concerns raised by you, and we would appreciate any further feedback. If any additional analyses or experiments are in order, we would gladely add them. If not, and all of your concerns were resolved, we would appreciate your response, and if you could consider raising your scores accordingly. Thank you again for helping us improve the paper.