- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes BioCoReT, a two-stage framework for bioactivity prediction from molecular structure and Cell Painting data under sparse assay labels. Stage 1 learns a task-agnostic compound representation through contrastive learning over fused multimodal views built from different replicates and matched with controls, rather than aligning the two modalities directly. Stage 2 trains assay-specific teachers, filters their predictions into pseudo-labels using teacher confidence, molecular and morphological topology, and replicate consistency, and uses them to train a multitask student. The authors report consistent gains over existing methods on three public Cell Painting benchmarks, along with an interesting reduced-label ablation.
(Edit: Most concerns addressed during rebuttal, score updated to a 3 accordingly).
Critical strengths
The paper addresses an important and challenging problem: improving bioactivity prediction with limited and sparse data. Progress here has clear practical value.
The design is adapted to real properties of the data: replicate structure, imperfect alignment between modalities, and sparse, heterogeneous labels. Its assumptions are generally reasonable, which makes the approach promising despite its complexity.
Critical weaknesses
The main results and ablations report no standard deviations across seeds or cross-validation folds, and hyperparameter tuning is not described. Without these, the improvements over the baselines cannot be properly judged.
Lack of details in the main text and no indication of code publication. The main text lacks key method details: architectures, whether the pretrained encoders are frozen, what the teacher model is, and which components are trained. This makes the setup hard to understand and reproduce. There is no indication that code will be released. Given the complexity of the pipeline, a code release is necessary for the work to be reproducible and useful to the community.
Addressing these two would make me inclined to increase my score to weak accept.
Questions for authors
Can you report standard deviations across seeds or folds for the main results and ablations? Is cross-validation used, and how were hyperparameters tuned?
Are the datasets split randomly by compound or by structural similarity, i.e., do the splits require scaffold hopping?
Which components are trained versus frozen? What are the architectures and training data of the pretrained image and molecular encoders, and are they built for Cell Painting data?
What model is used for the assay-specific teachers? How is overfitting avoided with a few hundred or fewer labels per assay? How are the reliability weights and pseudo-label thresholds chosen?
Which representations are used for the topology and replicate consistency scores? Are they control-adjusted or normalized, and do they come from trained or frozen extractors?
Does the reliability filtering mainly select very easy examples as pseudo-labels?
How does the unimodal-to-multimodal alignment loss avoid reducing the representation to the information shared by both modalities, the problem raised with activity cliffs and scaffold hopping?
Are the hidden-label accuracies in Section 4.5 balanced or raw, given the class imbalance?
In Section 3.1, does “matched untreated control image for replicate R” mean the DMSO control on the same plate?
Is “JUMP 29” in Figure 4 the same dataset as CPG0016? If so, please use consistent naming.
Global Response
We thank the Area Chair and reviewers for their careful assessment and constructive feedback. We are encouraged that the reviewers recognize the practical importance of bioactivity prediction under sparse supervision (mZy2, s8Re), the biology-aware multimodal representation learning design (E3Rn, s8Re), and the strong performance across three benchmarks (mZy2, E3Rn). We have addressed their main concerns through additional experiments, methodological clarifications, and manuscript revisions:
Activity cliffs and scaffold hopping: We add targeted scaffold-hopping retrieval and activity-cliff evaluations, where BioCoReT outperforms the compared baselines. We further clarify how fused-view contrastive learning preserves complementary molecular and morphological information and add comparisons with InfoAlign and ACANet (Reviewers mZy2 and s8Re).
Technical noise and biological preservation: We provide cross-plate replicate retrieval experiments and an additional CCRE ablation, demonstrating improvements beyond both raw DINO and Stage 1 without CCRE. These results further support CCRE's contribution to mitigating technical variation (Reviewer mZy2).
Pseudo-label reliability and downstream contribution: We add student-level CTPL ablations, class-wise pseudo-label precision, and reliability-weighting comparisons. Additional evaluations under conflicting reliability signals and sparse neighborhoods further support CTPL's robustness (Reviewers E3Rn, mZy2, and s8Re).
Reproducibility and methodological clarity: We clarify compound-level splits, pretrained encoders, trainable components, teacher architectures, and hyperparameter tuning. We also provide variability results for the main experiments and ablations, alongside additional implementation and evaluation details (Reviewers s8Re and E3Rn).
We appreciate Reviewer mZy2's acknowledgment that the additional experiments address several original concerns and strengthen the empirical evidence for BioCoReT. We also appreciate Reviewer s8Re's recognition that most concerns have been addressed and their subsequent decision to increase the rating. We further appreciate Reviewer E3Rn's positive assessment of our multimodal learning design and comprehensive evaluation.
We sincerely thank the Area Chair and all reviewers for their constructive feedback.