- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Products on eCommerce platforms are often tagged with multiple attributes. Several applications may require the products to be clustered (or grouped) on the basis of a given attribute. The paper poses it as instruction-conditioned multi modal clustering problem. It proposes CIM-Embed, which fine-tunes Qwen3-VL-Embedding with supervised contrastive loss. The object/product embeddings can then be clustered using existing clustering algorithm HDBSCAN, without specifying the cluster count. The proposed method presents significant benefits over general purpose embeddings (e.g., WeMM-9B) as well as other domain specific baselines including GCPM, ABC, CLAY, ITGC and Multi-Stub. The results are also reported on Cards and CLEVR-4 benchmark datasets to demonstrate transferability to other domains.
The paper also presents the ProductMIC dataset from Amazon Reviews 2023, with VLM-extracted and metadata-verified attribute labels. The proposed dataset has 449 tasks over 5,373 products in 50 held-out leaf categories.
Updated the score based on the discussion during rebuttal.
Critical strengths
- The paper addresses a real-world problem concerning multiple eCommerce platforms.
- The ProductMIC dataset can be useful for researchers or practitioners working in this domain.
- The proposed method achieves significant gains over general-purpose embeddings including WeMM-9B, Qwen3-VL8B and Gemini Embedding 2. For instance, WithinSupCon variant achieves V-measure of 95.01, as compared to 53.06 for WeMM-9B.
- The proposed method achieves significant gains over baselines including GCPM, ABC, CLAY, ITGC, Multi-Stub. For instance, Direct Within reaches V=95.01 and ARI=0.9238 as compared to 74.85 and 0.5786 for GCPMG3.
- The results are also presented where the frozen product-trained encoders are applied for conditional grouping on other tasks including Cards and CLEVR-4. For instance, Direct Within achieves V=88.55 (baseline is 56.36) on Cards and V=66.46 (baseline is 42.07.36) on CLEVR-4 with Qwen-8B base model.
Critical weaknesses
- Useful baselines are missing: (i) Fine-tuning the same backbone with simpler objectives, such as attribute classification heads, triplet/conditional-similarity losses, or an instruction-concatenated InfoNCE variant that is not confounded with sampling. (ii) Directly predicting attribute values with the VLM and grouping by exact match. This corresponds to the annotation pipeline used for label annotation, and it may be a strong baseline. (iii) Finetuning ABC and CLAY on ProductMIC-Train.
- CIM-Embed receives image, title and description, while ABC, CLAY, ITGC and Multi-Sub receive image + instruction only (#1619-24). Titles and descriptions often state color, size and so on directly, so this alone could explain much of the gap. A text-only and an image-only CIM-Embed ablation would be helpful.
- Possible dataset biases: (i) 7.5% of evaluation labels are model-supplemented. No human audit or error-rate estimate is reported. (ii) The same model family is used to annotate a subset of dataset.
- Missing train and inference times.
General suggestions:
- The paper overall is well written; however, it is appendix heavy. Please consider re-structuring so that the key points are in the main paper itself.
- Consider adding real world benefits for a wider audience.
Questions for authors
- Are the numbers available for GCPM, ITGC and Multi-Sub on Cards, CLEVR-4 and CIFAR10-MC under the same clustering protocol as the CIM-Embed transfer runs? This may provide a good baseline for transfer leaning.
- How does the model do on held-out attribute names, paraphrased instructions, and held-out attribute combinations?
- Please comment on decoupling the loss from sampling, for example InfoNCE with partition-structured batches, or SupCon with random batches?
- Consider adding more baselines -- please refer to 1 above (especially 1(ii)). Not all of them are required, but some may help strengthen the paper.
- How do results differ on Details-verified labels only? An ensemble annotator should be considered if the results vary significantly.
Additional cross-domain comparisons under the original evaluation protocol
We have completed the ITGC and Multi-Sub comparisons on Cards, CLEVR-4, and CIFAR10-MC. Each method and dataset independently selects one parameter setting from the original CIM search space: 12 candidates on Cards and 48 each on CLEVR-4 and CIFAR10-MC. Selection maximizes V-measure averaged equally over instructions, using the target labels as in the original protocol. Ties are resolved by mean coverage and then grid order. All samples are scored, with the remaining noise label treated as a shared predicted cluster.
CIM achieves higher average V-measure than both methods on all three datasets under this protocol. These results replace the earlier pending entries for Multi-Sub; they are distinct from the fixed-ProductMIC-parameter transfer diagnostic.