- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces MicroPool-2M, a dataset of about 2.5M single-channel fluorescence microscopy images labeled by (structure, cell line). Each image has three types of text: a category template, GPT-generated knowledge, and a detailed caption generated by Qwen using both the image and its label. MicroCLIP fine-tunes DFN2B-CLIP ViT-B/16 with standard InfoNCE. Training samples one caption type per image, uses MetaCLIP-style balancing, and includes 0.6M natural image-text pairs. The paper reports large gains over general-purpose CLIPs in zero-shot classification across held-out splits and in image-text retrieval.
Critical strengths
The dataset is sizable. Holding out compositions, cell lines, structure sets, and sources makes the evaluation useful for examining generalization. The training recipe is also clearly specified and follows established CLIP data practices.
Critical weaknesses
-
My main concern is the lack of evaluation and justification for the synthetic captions, since the three-level caption supervision is the paper's central contribution.
The abstract says that the captions are verified, but the paper gives no verification procedure. For the detailed captions, there is no human audit, hallucination rate, or diversity analysis, and the examples are highly templated. The GPT-generated knowledge captions have no reported factual checks either.
Label leakage is another concern. The generator receives the category name, and the examples repeat that label in the caption. Without a comparison between label-conditioned and image-only generation, I cannot tell whether the gains come from visual descriptions or from the labels.
The choice of Qwen3.5 also needs justification. It is a general-purpose MLLM, and both the paper's Section 3 and prior work in μ-Bench show that such models are unreliable on microscopy images. The captions may therefore contain little visual detail or include hallucinations. The paper compares neither alternative MLLMs and model scales nor domain VLMs. It also does not compare the knowledge captions with curated sources such as UniProt or Cellosaurus.
Finally, retrieval queries come from the same generator as the training captions. The retrieval results therefore partly measure how well the model fits that generator's style.
-
The baseline comparisons omit several relevant microscopy-capable CLIPs: BiomedCLIP, BMCA-CLIP, CellCLIP, and MorphoCLIP. CellCLIP is cited but not evaluated. The general-purpose CLIPs used as baselines have never seen cell-line names and score near chance. Category-only fine-tuning is the fair reference here, with a Compositional score of 56.47 compared with 67.70. The paper also needs fine-tuned baselines, such as BiomedCLIP or BMCA-CLIP trained with the same recipe, and a factorized supervised classifier.
-
The evaluation protocol inflates the results. Classification ranks candidates only within each subset, rather than using generalized compositional evaluation. The retrieval baselines score 0.0 to 0.7% R@1, close to the 0.1% chance level. There is no evaluation on an external benchmark such as μ-Bench and no check for catastrophic forgetting. It is also unclear whether the splits are grouped by field of view or plate.
Questions for authors
Results that need clarification
- Retrieval without auxiliary data is 39.4 in Table 2, 32.4 in Table 3, and 60.1 in Table 4.
- Cell-DINO scores 0.98% on Compositional Shift, below the 1.56% chance level for 64 classes.
- Adding data hurts performance on Cell-Line and Source Shift. The full recipe is not the best on Source Shift, scoring 36.53 compared with 40.59.
Other questions
- How was caption quality verified? Please report a human audit, hallucination rate, label-mention rate, and diversity.
- How do the results change with image-only detailed captions, other caption generators, or curated knowledge sources?
- How do BiomedCLIP and BMCA-CLIP perform both zero-shot and after fine-tuning with the same recipe?
- What are the results under generalized compositional evaluation and on μ-Bench?
- How are duplicate texts within a batch handled, and which configuration does each row of Tables 2 to 4 use?
I would be willing to raise my score to 3 if the authors could solve my concerns.
Clarification on Biological Motivation and Additional Downstream Evaluation
We thank the reviewers for their careful assessment of our work. We would like to clarify the intended role of language and provide additional evidence connecting our approach to biological applications.
Biological motivation and the role of language.
We agree that microscopy images contain rich quantitative information. Our aim is to explore whether language can serve as a complementary interface that helps researchers specify visual features they wish to retrieve. For example, knowing the cell line and staining target does not determine the morphology or state of every individual cell. A description such as “condensed chromatin” can express a visual criterion that acquisition metadata may not directly capture. This motivates our exploration of joint image–text representations.
Additional downstream evaluation.
The reviewers’ comments highlight the importance of distinguishing between evaluating generalization across categories and their combinations and addressing biologically meaningful tasks. To provide additional evidence beyond the original recognition benchmarks, we conducted downstream experiments on protein localization, cell-state recognition, and cross-protein retrieval, alongside classification of projected 3D cell images. The results are summarized below.
All values are percentages; “—” indicates an unevaluated setting. Protein localization and cell-state recognition use text-encoder-only fine-tuning, while cross-protein retrieval uses frozen visual features. The 3D task classifies 2D maximum-intensity projections using text prompts.
These results complement our motivation for using language as an interface to microscopy images by demonstrating that the learned representations also transfer to protein localization, cell-state recognition, and cross-protein retrieval. They provide additional evidence connecting our representation-learning approach to the practical biological applications raised by the reviewers.
We appreciate the reviewers’ feedback, which has helped us clarify both the motivation and the scope of the evidence.