- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper (UniCell) adapts the pretrained BAGEL model to microscopy images to combine visual question answering, object localization and image generation. It has understanding and generation modules within a shared backbone, which are trained sequentially -- understanding adaptation is performed first, and then generation adaptation is performed with understanding part frozen. The generator is conditioned on "phenotype-text" which is either inferred using understanding part or taken from external-VLM annotations checked on samples by experts.
Evaluation consists of two benchmarks for understanding (Micro-Bench and MicroVQA), one for localization (Micro-Bench), and one for generation (BBBC021). Understanding results nearly match results from finetuned Qwen2.5-VL-7B but are slightly overall worse, while outperforming selected models without benchmark-specific finetuning. For localization they show improvement over Qwen2.5-VL-7B and selected methods without benchmark-specific finetuning. For generation they show reported improvement compared to other methods on seen and held-out compounds.
Critical strengths
- The phenotype-text conditioning is a neat idea and shows improvement over baselines on both seen and held-out compounds across image-distribution and MoA-classification results. These gains are strongest empirical contribution (subject to clarification of baseline conditioning and evaluation details).
Critical weaknesses
-
Limited methodological novelty and scope. The paper adapts an existing unified architecture through sequential finetuning and phenotype-text conditioning on different data domain. The integration between components (understanding and generation) is limited and one-directional: inferred phenotype descriptions and representations are used directly for generation, and generation doesn't feed back into understanding.
-
Empirical evaluation leaves much to be desired
- understanding + localization: Qwen2.5-VL-7B finetuned model is the only direct comparison which was also tuned on these datasets, but Qwen2.5-VL-7B is quite old, results should be shown for newer models like finetuned Qwen3.5/Qwen3.8 or Gemma4. Comparison to non-finetuned models is a useful complementary result, but they receive less benchmark-specific supervision, so improvement over them does not establish an advantage of the architecture or training method. Also non-finetuned baselines should be up-to-date, e.g. Gemini-3.8-Flash instead of Gemini-2.5-Flash, GPT-6-Astra instead of GPT-4o, Qwen3.8 instead of Qwen2.5-VL. These models are 1-2 years old. No repeats/cross-validation were reported and uncertainty estimates are not shown in the table. The custom 90/10 splits are not specified and don't have sufficient specification about image grouping, exact evaluation counts, or the ordering of splitting and answer-option rotation. Because multiple questions can share an image, inappropriate splitting could cause the leakage, so it doesn't establish whether evaluation measures generalization to unseen images or new questions about familiar images.
- generation: there's only one generation dataset, involving one cell line and eight held-out compounds whose mechanisms are represented in training. Again no reruns and uncertainty estimates were reported.
-
Insufficient evidence that unification/biological understanding explains the gains. The Stage 1 ablation supports the usefulness of understanding-first adaptation, but doesn't separate improvements in predicted phenotype descriptions from improvements in the internal representations used during generation, or establish an advantage over a modular approach. There are no ablations where generation uses conditioning (either text, or text+representations) from independent Stage 1 adaptation but finetuned from BAGEL directly, not from Stage 1. The experiments demonstrate an effective overall recipe more clearly than they establish benefits of unification.
-
Insufficient biological validation of phenotype-conditioned generation. The paper doesn't systematically evaluate whether inferred descriptions for held-out compounds are correct or generated images show their predicted morphological changes. Expert validation covers only sampled training-annotation observations, rather than predictions. FID/KID and MoA classification are useful evidence but don't establish morphological correctness. This leaves the central phenotype interface insufficiently validated.
Questions for authors
-
Generation comparison and reproducibility. What exact compound representations/conditioning did DDIB, IMPA, and CellFlux receive, including dose? How were held-out compounds represented? Specify configuration, checkpoint sources, training splits, and whether checkpoints were retrained or reused. An anonymous package containing generation/evaluation scripts and manifests would be perfect. These details would help verify the improvements and assess fairness.
-
Understanding splits and independence. How were custom 90/10 splits selected? Were examples grouped by original image/source before splitting and answer-option rotation? Please provide image/question counts, split manifests, and overlap checks.
-
Held-out-compound exposure. Were images or compound-specific phenotype annotations of the eight held-out compounds present in understanding-stage training? Was overlap with BBBC021's held-out images or conditions checked? Please clarify which parts of your pipeline exclude those compounds. This concerns evaluated images and phenotype-conditioning, rather than ensuring that the pretrained model has no general knowledge of these compounds.
-
Baseline settings. Please provide prompts, inference settings (including Gemini 2.5 Flash's thinking budget), and handling of failed/truncated responses. Did you run anything across multiple seeds / cross-validation (including training where appropriate) to get any measure of uncertainty/noise of results? Do you have comparisons with newer VLMs (Qwen3.5/3.8, Gemini-3.8-Flash, GPT-6-Astra/6.1-Sol) or generation models such as CellFluxV2? An evaluation of a strong generation baseline, such as CellFlux, adapted to receive the same phenotype descriptions and explicit dose information as UniCell, would help separate the benefit of conditioning from the benefit of architecture and adaptation. The request is for representative evidence, not for all possible new published models/methods.
-
Stage 1 and unification. For unseen compounds in Table 4, were descriptions/conditions generated separately by each variant, or generated once and reused across variants? Could you add to ablation a setup in which a Stage-2 generation model is trained from base BAGEL but descriptions/conditions are passed from Stage-1 (best same as in final model)? This would test if access to Stage-1 trained weights adds value beyond the phenotype-text part.
-
Biological validation. Can you provide validation of the predicted phenotype descriptions for held-out compounds, and check whether generated populations show the predicted morphological changes?
(1/3)
Dear Reviewer,
Thank you very much for your careful reading of our submission and for your detailed and constructive comments. We genuinely appreciate the time and effort you invested in identifying the limitations of our evaluation, the missing analyses, and the claims that were not yet sufficiently supported.
Given the extent of the revisions required, we have decided to withdraw this version and substantially improve the work. In particular, we plan to:
Results already obtained (BBBC021, three held-out compound folds)
Several of these items are already done. We re-ran the BBBC021 experiments on three disjoint held-out compound folds (each holds out 8 of the 34 compounds, 24 held out in total) and report mean ± std over folds. One MoA classifier scores every method and fold. We trained it with the official CellFlux script on the training-split images of all 34 compounds and score only test images; the generator never sees the held-out compounds. The submitted version used the released CellFlux classifiers, which are tied to a single split; the one for unseen compounds has 7 classes (the 6 MoAs of that split's 8 held-out compounds, plus DMSO). Our classifier has 13 classes, all 12 MoAs in BBBC021 plus DMSO, which covers the MoAs of every split, so a single classifier scores all splits. With more classes to choose from, it is a harder test: on fold 1, real unseen images score 73% with it and 88% with the 7-way released classifier. Unseen MoA accuracies are therefore lower than in the submitted version, and the numbers are not directly comparable.
Generation vs. baselines. We trained DDIB, IMPA and CellFlux on each fold and scored all methods with the same metric code. Our model is best on all metrics in both splits, reducing FID_o by 62% on seen and 30% on unseen compounds relative to CellFlux. CP-Δr (×100) is the correlation, in CellProfiler features, between the generated and the real morphological change from control; for real images, it is the correlation between two halves of the real images, an upper bound. Real images are shown as a reference and are not bolded.