- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This manuscript proposes an evolutionary framework (GxEvo) for transcriptome-conditioned molecular generation. Instead of generating molecules independently from a transcriptional condition, GxEvo iteratively refines a population of candidates using a learned forward response model and a parent-conditioned mutation operator. The model combines response prediction with contrastive learning to provide a fitness signal for evolutionary selection. The experimental results on ten gene-knockdown targets and three held-out drug–cell splits show improvements in structural similarity and novel hit scaffold generation. The authors also conduct candidate-budget comparisons and ablation studies to evaluate the contributions of the proposed components.
Critical strengths
-
First, this manuscript addresses a meaningful limitation of existing transcriptome-conditioned molecular generators: independently generated candidates cannot directly guide subsequent proposals. The proposed population-based search provides a reasonable way to refine promising molecules. I particularly appreciate the candidate-budget comparison in Table 2, where GxEvo outperforms independent sampling from its own seed generator under the same proposal budget.
-
In addtion, the authors they compare GxEvo with seven existing TBDD methods and evaluate both gene-knockdown targets and held-out drug–cell conditions. The comparisons with alternative forward response models and mutation operators are also useful. In particular, removing InfoNCE reduces novel hit scaffold yield from 23.83 to 14.08, supporting the importance of candidate discrimination in the evolutionary process.
Critical weaknesses
-
The main knockdown results use structural similarity to known actives as a proxy for hit-likeness, while the evolutionary fitness is calculated using predicted transcriptional responses. Although Appendix J provides an additional evaluation using an external response predictor and measured target signatures, it still relies on computationally predicted responses for generated molecules. Therefore, the results do not directly establish that the generated molecules would induce the desired transcriptional changes or exhibit the intended biological activity.
-
Also, GxEvo evaluates 1,500 candidates to return a population of 100 molecules. According to Appendix C, the full search takes approximately 401 seconds per target, compared with 3–8 seconds for several baseline generators and approximately 70 seconds for CURE. Although the authors provide candidate-budget controls, the substantial difference in wall-clock cost limits the practical efficiency advantage of the method. A comparison under matched computational time would help clarify this trade-off.
Questions for authors
-
Since the evolutionary fitness is based on a learned response predictor, how can the authors ensure that repeated optimization does not exploit inaccuracies in this model? Appendix J provides an external response-model evaluation, but could the authors further analyze whether the agreement between the search fitness and independently predicted response alignment changes across evolutionary generations?
-
GxEvo uses a substantially larger computational budget than most baseline generators. Could the authors provide a comparison under matched wall-clock time, or discuss how the performance changes when the number of generations or evaluated candidates is reduced? This would help clarify the practical trade-off between generation quality and computational cost.
5 comments
Author Response (2/3)
Question 1 - Fitness and Independent Evaluation Across Generations
GxEvo improves both structural alignment and independently predicted response alignment over the knockdown search. Our reward approximates transcriptional responses, so repeated optimization may exploit prediction errors and increase fitness without improving independently evaluated alignment. The MOLLEO control illustrates this risk: under the same reward, its fitness increases while mean maximum Morgan similarity to known actives peaks at generation 2 and then falls below initialization.
To reduce reliance on surrogate scores alone, GxEvo couples reward-based selection with a learned mutation operator conditioned on both the parent and target response. The operator is trained on LINCS molecule pairs using the child's measured response, providing a response-informed proposal prior alongside the reward. We tracked fitness and independent structural alignment to compare the resulting search trajectories; the structural metric is unavailable to the reward in either method. We also scored the saved GxEvo populations with TranSiGen at eleven generation checkpoints, using W1's Level-5 reference and scoring procedure over all ten targets.
| Generation | GxEvo reward | GxEvo Morgan | GxEvo TranSiGen alignment | MOLLEO reward | MOLLEO Morgan |
|---|---|---|---|---|---|
| 0 | .1522 | .3318 | .0627 | .1487 | .3294 |
| 2 | .2312 | .3514 | .0788 | .2390 | .3813 |
| 4 | .2613 | .3583 | .0879 | .2791 | .3681 |
| 12 | .3073 | .3705 | .0992 | .3437 | .3296 |
| 20 | .3237 | .3713 | .1030 | .3729 | .3132 |
GxEvo retains improved structural alignment through generation 20, while TranSiGen response alignment increases from .0627 to .1030. This contrast is consistent with response-informed variation helping limit the structural drift observed with MOLLEO under the same reward on this benchmark. GxEvo's final novel hit scaffold yield is 23.83 per 100 valid molecules, compared with 12.60 at MOLLEO's generation-2 Morgan peak. GxEvo thus combines sustained improvement in population similarity with greater scaffold breadth.
One MOLLEO seed and four GxEvo seeds. TranSiGen does not participate in search; its endpoint scores reproduce W1's evaluation and retain the same interpretation.
The held-out conditions tell a less uniform story. There we evaluated Appendix J's PRnet-based response-specificity lift at eleven points during search. This compares predicted responses with the requested measured response and other measured responses in the same cell; PRnet does not participate in search. Values use Table 24's normalization, with random ZINC at 0 and the ground-truth drug at 100.
| Split | Lift at gen 0 | Peak lift | Lift at gen 20 | Net change | Spearman(fitness, lift) |
|---|---|---|---|---|---|
| RANDOM | 83.6 | 96.6 (gen 14) | 95.9 | +12.3 | +0.83 |
| SCAFFOLD | 92.8 | 92.8 (gen 0) | 91.7 | -1.1 | +0.11 |
| CELL | 83.9 | 90.4 (gen 4) | 87.4 | +3.5 | -0.31 |
Independent response-specificity lift finishes above initialization on random (+12.3) and cell (+3.5), while remaining approximately flat on scaffold (-1.1). On the cell split, alignment peaks around generations 4-6 and then declines while fitness continues to rise, a pattern consistent with late-stage reward exploitation, although the final score remains above initialization. Each Spearman coefficient is computed across the eleven population-average generation checkpoints (0, 2, ..., 20). A practical mitigation is to choose the stopping generation on separate validation conditions using saturation of an external response metric, then fix that generation before evaluating held-out conditions. This question improved our analysis of the search. We have added the generation-wise results and discussed validation-based stopping in Appendix I; selecting a stopping generation on separate validation conditions remains a proposed mitigation rather than an evaluated stopping rule.
Author Response (3/3)
Weakness 2 / Question 2 - Computational Budget and Earlier Stopping
GxEvo retains higher mean similarity and novel hit scaffold yield when baselines receive an expanded generation allowance, while earlier stopping offers a practical way to reduce its cost. For the baseline comparison, we allocate GxEvo's full search time to candidate generation and then apply our reward model to select the best 100 molecules, as in Table 2.
We measured generation throughput for five baselines and GxEvo's total search time in the same session on one otherwise-unused GPU, then estimated the candidate counts that fit this generation allowance. Reward scoring and selection are additional to the baseline generation allowance, giving the baselines more total computation than the reference search budget. The resulting draw budgets are 65x-5,696x larger than the 1,500-draw control, reaching up to 8.5M candidates per target. For GexMolGen and CURE, Appendix C-based cost estimates imply generation allowances of 526 and 782 draws; we retain their larger 1,500-draw controls.
Mean similarity to the target's known actives, averaged over ten MCF7 knockdown targets:
| Method | Published | 1,500 draws + reward | Expanded generation allowance + reward | Candidate draws in expanded control |
|---|---|---|---|---|
| TRIOMPHE | .2049 | .2117 | .2053 | 905,119 |
| GxVAEs | .2779 | .2714 | .2813 | 7,468,264 |
| FAME | .2716 | .2737 | .2907 | 97,253 |
| SmilesGEN | .2810 | .2944 | .2971 | 8,543,677 |
| Gx2Mol | .2990 | .3136 | .3063 | 1,071,204 |
| GexMolGen | .2946 | .3063 | - | 1,500 (retained control) |
| CURE | .2842 | .2620 | - | 1,500 (retained control) |
| GxEvo | - | .3713 | .3713 | 1,500 |
Increasing the sampling budget beyond 1,500 yields limited additional improvement. Despite a 65x-5,696x increase in draws under the expanded generation allowance, mean similarity improves by at most .017 and decreases for some baseline configurations. Novel hit scaffold yield reaches at most 6.8 per 100 molecules, compared with 23.83 for GxEvo. Paired over the ten targets, GxEvo exceeds every baseline evaluated with the expanded generation allowance and reward selection on both metrics. Gx2Mol's best-of-population similarity also decreases from .748 at 1,500 draws to .488 at 1.07M draws, compared with .617 for GxEvo.
Earlier stopping provides a complementary way to reduce GxEvo's cost. The population stored at each generation is the output that a run stopped at that point would return. The following checkpoints use the same four seeds as Tables 1-2; intermediate times are estimated with the Appendix C cost model, using the measured seed-only and full-search times as endpoints.
| Generation | Candidate draws | Time (s) | Mean similarity ↑ | NHS/100 valid ↑ |
|---|---|---|---|---|
| 0 | 100 | 29.4 | .3318 | 12.64 |
| 6 | 520 | 140.9 | .3620 | 19.65 |
| 12 | 940 | 252.5 | .3705 | 22.50 |
| 20 | 1,500 | 401.3 | .3713 | 23.83 |
Generation 6 requires 35% of the full wall-clock time while retaining 76% of the mean-similarity gain and 63% of the novel hit scaffold gain. Mean similarity plateaus around generations 12-14. Together, the expanded-baseline controls and generation-wise results show that GxEvo's quality advantage persists with greater baseline compute, while earlier stopping retains most of the improvement at substantially lower search cost. We have added both analyses to Appendix C and summarize the cost trade-off in Section 4.3.
We thank the reviewer again for the questions, and we are happy to discuss further.
Author Response (1/3)
We thank the reviewer for the positive assessment and the helpful questions. We address them below with new generation-wise analyses and expanded-generation-budget comparisons on the same settings as the paper.
Weakness 1 - Complementary Response-Based Evaluation
GxEvo has higher mean knockdown-response alignment than all seven published generators under both XPert and TranSiGen, extending the response-based evidence beyond Appendix J's held-out conditions. The analysis extends Appendix J's evaluation to the knockdown populations, using two separately trained predictors, XPert and TranSiGen, that take no part in the search. Their separation from the search avoids directly reusing its fitness scores, although shared data sources and correlated model errors remain possible, and experimental measurements remain necessary to establish the effects of the generated molecules.
We score predicted responses against published Level-5 CGS knockdown signatures, with known actives, off-target actives and random molecules as references. The search conditions on Level-3-derived targets (Appendix B), while this score uses Level-5 CGS signatures, which add plate-relative standardization and shRNA consensus, so the change is one of preprocessing rather than a held-out experiment. TRIOMPHE and GxVAEs also use Level-5 profiles for conditioning, and GxEvo still ranks above them. Since the predictors' outputs and the CGS signatures are not calibrated to each other, we read these scores as connectivity across representations rather than as prediction error.
Mean predicted-response alignment against Level-5 CGS signatures, averaged over all ten knockdown targets:
GxEvo's mean score also exceeds the off-target and random controls under both predictors and is comparable to the known-actives reference. To assess ranking utility, we test whether the same score ranks a target's real ExCAPE actives above random ZINC molecules, with no generated molecules involved. XPert meets the AUROC threshold of .60 on 6 of 10 targets and TranSiGen on 7 of 10. Within each predictor's passing subset, GxEvo's advantage holds across every target and baseline. Our reply to Q1 tracks both search fitness and independent evaluation across generations. The knockdown evaluation and per-target predictor checks are now reported in Appendix J.