- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This study introduces RePert, a framework for inverse perturbation retrieval from transcriptional responses. More specifically, the goal is to generalise across cellular contexts and experimental platforms.
RePert combines contrastive pretraining of an effect encoder with a non-parametric memory of perturbation-specific effect prototypes, and a discriminative retrieval model whose identity embeddings are aligned with these prototypes. Then, at inference, identity-based and effect-based retrieval scores are combined using a validation-selected weighting parameter.
Evaluation is performed across six settings, reporting improvements over existing approaches.
Critical strengths
RePert addresses a relevant research direction: inverse perturbation retrieval is an interesting, contemporary problem with enormous potential in drug discovery.
The experimental framework is well-designed and covers a satisfactory range of tasks and settings. I particularly valued the cross-platform experiment (although it would be good to have statistical tests on the tables' results and pay more attention to numerical precision and significant figures).
Code is released and matches the architecture described in the paper. There are no preprocessing steps or splits available, so proper reproducibility of results cannot be established.
RePert has promising empirical performance compared to other models. Most interestingly, against DrugReflector.
The framework is composed of a relatively simple and efficient architecture, providing a potentially valid alternative to heftier solutions.
Critical weaknesses
The Manuscript
The manuscript is -- in my opinion -- generally poorly structured. The relatively simple framework is unnecessarily complicated by the unintuitive presentation. The different experimental settings are mentioned as C1-6 on page 3, while Table 1 is introduced on page 5 and located on page 6. Table 4, top1% gain should be ~1.2 if I am not wrong. Additionally, citations should be in parentheses unless the reference itself is part of the sentence. Arrows on Figure 1 are badly aligned, and "our proposed" sounds like incomplete labelling. I struggle to believe that anyone reviewing this paper internally would not notice how hard it is to follow.
Scientific Claims
I think that baseline comparisons would benefit from further clarification. In C1-C3, several baselines were originally designed for a different task (forward perturbation prediction), and it is not clear to me whether any attempt to adapt them has been performed or not. Although these settings seem to follow those from PDGrapher, I find the comparison principally flawed.
The contribution of the individual components could be explored further. It would be particularly informative to extend the ablation analysis to the held-out cell-line and cross-platform settings, where the proposed effect representations and identity grounding are expected to be most useful. I would also appreciate clarification of the term "reliability-calibrated", as the current procedure appears to select a global combination weight based on validation performance, rather than explicitly modelling the reliability of individual predictions or effect prototypes.
Questions for authors
Q1. Novelty and simpler baselines. Could the authors provide a more detailed discussion of the relationship between RePert and existing supervised contrastive or prototype-based retrieval methods? In particular, it would be interesting to compare against a supervised contrastive encoder with nearest-prototype retrieval and a straightforward MLP retriever trained with the same candidate-level objective. I believe this could help isolate the benefits of the proposed effect memory and identity-grounding mechanisms.
Q2. Baseline adaptation and experimental fairness. Could the authors clarify how the forward-model baselines in C1–C3 were adapted to inverse retrieval? Were these models directly optimised for retrieval, or were their predicted responses used for candidate matching?
Q3. Component ablations under distribution shifts. Could the authors extend the component ablations to C3 and C5–C6, including independently trained identity-only models? Given that the main motivation for effect pretraining and grounding is improved generalisation, these experiments could help establish where the additional components provide the greatest benefit. A comparison with joint end-to-end training would also be interesting.