- Rating
- 2
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes HICON to address hierarchical technical variations across batches, plates, and spatial positions in Cell Painting data. The framework couples a technical branch with a biological branch: the former captures technical variations through hierarchical prototype assignments and confidence weighting, while the latter contrasts perturbation replicates weighted by technical similarity. A CLUB-style regularizer further decouples the two representations, effectively casting the objective as preserving biological signals conditioned on latent technical states. Extensive evaluations across four major benchmarks show improvements in batch correction, biological fidelity, and downstream retrieval across diverse settings.
Critical strengths
Strengths
-
Practically grounded problem formulation with well-aligned hierarchical modeling. HICON jointly addresses batch, plate, and spatial effects, reducing reliance on unreliable metadata through soft assignments and confidence weighting. Hierarchical technical prototypes, biological supervision based on replicate perturbations, and technical similarity weighting provide a clear modeling framework for simultaneously correcting technical differences and preserving biological signals. Component ablations also support the contribution of several designs to performance.
-
Extensive evaluation demonstrating robustness and generalization. The experiments cover multiple datasets and feature sources, examining scenarios such as unseen perturbations, unseen imaging sources, reduced replicate counts, and metadata corruption. Combined with synthetic experiments with known latent structures, these results provide valuable evidence for assessing the method's effectiveness and scope of applicability. Improvements across multiple individual biological metrics also support its ability to retain biological signals.
Critical weaknesses
Weaknesses
- Discrepancy between overall score definition and reported values. The overall score is defined in the text as an unweighted average of three technical and four biological metrics. However, calculating the arithmetic mean from the seven printed values for HICON in Table 32 and Table 34 yields 0.57143 and 0.61714, whereas the reported numbers are 0.56 and 0.63. The reported figures instead match an equal weighting between the technical and biological group means, which alters the implicit weighting across individual metrics. This inconsistency undermines the auditability of the composite metric and affects comparative claims. The authors should standardize the aggregation protocol, clarify the handling of missing kBET values, and recompute the affected results.
- Theoretical contradiction in the mutual information lower bound and incomplete CLUB training details. While Eq. (28) sums over multiple positive samples, Eq. (30) continues to use a constant . When technical conditions are identical, biological representations are constant, and the positive sample count , the loss evaluates to . The stated bound then yields while the true mutual information is zero, directly contradicting Eq. (30).
Questions for authors
Questions
-
Clarification on aggregation protocol and necessary corrections: What exact formula was used to compute the Overall scores in Tables 32 and 34? Please recompute the overall results in both the main text and appendix tables in accordance with the protocol stated in Appendix D. In addition, please clarify how datasets lacking kBET were normalized, and whether method rankings and comparative conclusions remain unchanged. Providing per-run individual metrics alongside aggregated values would greatly facilitate auditability and verification.
-
Theoretical derivation clarifications: How is in Eq. (30) formally defined in the presence of multiple positive samples? How does the framework reconcile the constant-representation counterexample, as well as the discrepancy between selecting negative samples based on perturbation labels versus sampling from the true conditional marginal distribution? Without formal theoretical guarantees, could this section be explicitly repositioned as a heuristic motivation instead of an unestablished lower bound?
Global Response
We thank the Area Chair and reviewers for their careful assessment and constructive feedback. We are encouraged that the reviewers recognize the practical importance, hierarchical modeling, and extensive evaluation of HICON. We have addressed their main concerns through additional experiments, methodological clarifications, and manuscript revisions:
Supervision fairness: We add supervision-matched comparisons with SupCon and scANVI across seven benchmark settings. HICON consistently outperforms both methods. Additional comparisons with SupCon + Harmony and SupCon + Seurat CCA further demonstrate the benefits of joint technical conditioning and biological representation learning (Reviewers eCMc and d4bU).
Technical proxy validation: We provide compound-leakage analyses, pair-weight correlations, and representation-similarity evaluations. Confidence diagnostics further clarify the role of feature–metadata consistency (Reviewers eCMc, d4bU, and Ms6h).
Information-theoretic formulation: We clarify CMI as the primary objective and CLUB as an auxiliary regularizer, including their interaction under perturbation–batch dependence. We also revise the multi-positive theoretical derivation and provide CLUB implementation details (Reviewers eCMc and 2JrM).
Evaluation consistency and reproducibility: We clarify the Overall score aggregation, correct reporting inconsistencies, and verify that HICON remains ranked first across all 20 benchmark settings under both aggregation protocols. We further document baseline configurations, hyperparameter sensitivity, and confidence/momentum scheduling (Reviewers eCMc, Ms6h, and 2JrM).
We appreciate Reviewer eCMc's positive feedback on the additional comparisons and theoretical clarifications. We also appreciate Reviewer 2JrM's recognition that our revisions addressed their main concerns and their subsequent decision to increase the rating.
We thank the Area Chair and reviewers again for their constructive feedback.