- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates text-conditioned image similarity, where a textual description specifies the criterion by which images should be compared. The same pair of images may therefore receive different similarity judgments depending on whether the condition concerns color, shape, layout, or another attribute. The proposed method builds on Qwen3-VL-Embedding-8B. It independently encodes each image under the same textual condition and computes the cosine similarity between the resulting representations. The authors construct comparison samples through generative image editing, collect human judgments of which candidate is more similar to a reference image, and fine-tune the model accordingly. Evaluation covers perceptual similarity judgments, conditional image retrieval, and combinations of multiple conditions.
Critical strengths
- A clear research objective with practical relevance Specifying the comparison criterion through text makes the meaning of “similarity” explicit and allows users to express preferences concerning color, structure, style, and other attributes. This formulation can improve the controllability of image retrieval and visual evaluation while making similarity scores easier to interpret.
- Data construction tailored to the task, with human supervision The two data construction strategies respectively emphasize fine-grained differences along the same comparison dimension and changes in similarity rankings when the comparison condition changes. These strategies closely reflect the intended model capabilities. Human annotations also provide direct supervision for aligning the model with human perceptual judgments.
- Clear empirical improvements under the paper’s evaluation protocol In the main experiment, accuracy increases from 76.80% for the original 8B model to 87.85%, an improvement of 11.05 percentage points (Table 2). This result supports the effectiveness of the proposed training pipeline. Experiments involving multiple image sources and downstream tasks provide additional empirical evidence.
Critical weaknesses
- Limited novelty in the core problem formulation and model design Both text-conditioned image similarity and language-controlled image representations have direct precedents, including FocalLens [1] and TPIPS [2]. In particular, TPIPS includes a late-fusion model that uses the same backbone, independently encodes each image under a shared textual condition, and computes cosine similarity. The paper therefore needs to articulate more clearly what substantive advances it offers beyond existing frameworks.
- Insufficient direct comparisons with the closest methods The main two-alternative forced-choice (2AFC) experiments lack direct comparisons with closely related methods such as TPIPS [2]. Although CLAY [3] is included in the retrieval experiments, the overall evaluation remains insufficient to establish the proposed method’s advantages over its closest alternatives. Comparisons with the original Qwen model demonstrate the benefit of fine-tuning, but provide limited evidence of the distinctive value of the proposed approach.
- Potential limitations in the representativeness of the data and evaluation The main comparison data rely on generative image editing, and samples are filtered for relatively high agreement among annotators. This may favor the chosen editing distribution and cases with clear human consensus, while underrepresenting complex variations in real images, ambiguous cases, and disagreement among observers. Unintended changes to attributes outside the specified condition during editing could also reduce the precision of the supervision.
- Limited evidence for generalization and robustness to multiple conditions The out-of-distribution evaluation primarily assesses adaptation to new image sources, which does not sufficiently establish generalization to previously unseen comparison concepts. The experiments involving multiple conditions also exhibit substantial sensitivity to prompt order, suggesting that the model’s interpretation and handling of combined conditions remain unstable.
- Insufficient analysis of the sources of improvement The current evidence does not adequately disentangle the contributions of the overall data construction procedure, the two data strategies, the training objective, and the fine-tuning configuration. Consequently, it remains unclear which design choices primarily drive the improvements and which components are necessary. Controlled ablations that match the number of training samples and the training configuration are particularly important for establishing the independent benefits of Strategy 1 and Strategy 2. References [1] FocalLens Hsieh, C.-Y., et al. (2025). FocalLens: Instruction Tuning Enables Zero-Shot Conditional Image Representations. ICLR 2025 Workshop on Foundation Models in the Wild. arXiv:2504.08368. [2] TPIPS Wang, S.-Y., et al. (2026). The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric. arXiv preprint, arXiv:2607.18237. [3] CLAY Lim, S., et al. (2026). CLAY: Conditional Visual Similarity Modulation in Vision-Language Embedding Space. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). arXiv:2604.11539.
Questions for authors
Novelty: What is the substantive contribution beyond related work, particularly FocalLens and the concurrent TPIPS, and what evidence supports this distinction?
Comparisons: Can the authors provide a direct comparison with TPIPS’s late-fusion model under the same 2AFC evaluation protocol to clarify the proposed method’s relative strengths and limitations?
Data reliability: What evidence shows that the reported gains are robust to unintended changes introduced by image editing and to the choice of annotator-consensus threshold?
Generalization and robustness: What evidence supports generalization to unseen comparison concepts and reliable performance under semantically equivalent reorderings of multiple conditions?
Ablation studies: Under matched data and training budgets, which controlled ablations establish the individual contributions of the two data strategies, the training objective, and full-parameter fine-tuning?