- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes the Multi-route Memory-guided Cellular Agent with Calibrated Transfer (MMCA-CT) for differential expression (DE) detection and expression direction (DIR) prediction under unseen perturbations and cellular contexts. The framework employs factorized response memory to separate stable gene tendencies from perturbation-specific effects, generating response estimates based on molecular structure, drug targets, and mechanism similarity. Conditional transfer estimation then weights response predictions according to their expected predictive gain and transfer reliability, while utility-guided evidence selection retains response estimates expected to improve predictions. Finally, a frozen LLM uses the selected evidence and fused prediction to produce task decisions or biological rationales.
Critical strengths
1. A meaningful research problem and a well-motivated evidence transfer framework. Existing perturbation prediction methods can be dominated by stable gene-level response tendencies, while biological similarity does not necessarily imply predictive transferability. The combination of factorized response memory and conditional transfer estimation provides a reasonable approach to addressing these challenges.
2. MMCA-CT demonstrates improvements in both cross-perturbation and cross-cell-line prediction across five cancer cell lines. The results on DE detection and DIR prediction, together with the component ablations, provide encouraging evidence of its predictive effectiveness.
Critical weaknesses
1. The central factorization hypothesis lacks direct validation. A key contribution of this paper is the separation of stable gene tendencies from perturbation-specific effects through factorized response memory. However, assigning these biological interpretations to the decomposed components does not guarantee that the matrix factorization actually achieves such a separation. The current ablations demonstrate the predictive benefit of the memory module but do not independently validate the stability or perturbation specificity of the learned components. Without such evidence, the central claim underlying the proposed representation remains insufficiently substantiated.
2. The biological relevance of selected evidence remains unvalidated. Utility-guided evidence selection optimizes reductions in prediction log loss rather than the biological correctness or mechanistic relevance of the selected evidence. Although biological information is incorporated into candidate evidence construction, this does not establish that the final selection identifies biologically meaningful mechanisms.
3.Appendix F.4 reports that MMCA-CT underperforms Prior vote in all 128 eligible cross-perturbation gene-set–cell-line comparisons and underperforms same-drug response voting in 88 of 125 cross-cell-line comparisons. While these subgroup results do not invalidate the aggregate improvements, they raise important questions about the consistency and robustness of the claimed transfer benefits, particularly relative to simple response-based predictors.
Questions for authors
See weaknesses.
6 comments
Response to Reviewer rp1M [Part 2]
Q2. Biological relevance of selected evidence
Our evidence for biological relevance combines response recovery in a defined biological panel with an example of traceable mechanistic interpretation. MMCA-CT links query-specific response evidence to biological knowledge to formulate explicit, testable mechanistic hypotheses. Utility prioritizes memory and coexpression response estimates expected to improve prediction beyond observed responses. The LLM interprets them alongside retrieved drug-target and pathway relations and source-linked response records in the queried cellular context (Section 2.4).
- Biologically relevant response recovery. In BRAF V600E-mutant C32, treated responses to the held-out BRAF inhibitors are excluded from fitting and retrieval. On the RAS-RAF-MAPK response panel, defined from Hallmark KRAS signaling sets and Reactome pathway participants, MMCA-CT correctly predicts 15 of 21 directions for dabrafenib and all 23 for vemurafenib. These results support response recovery within a biologically defined panel relevant to the perturbation and cell context (Section 3.5).
- Traceable mechanistic interpretation. For AT7519-FOS in held-out C32, the evidence combines same-drug, same-gene responses from source cell lines with a coexpression estimate using source-cell responses of 17 neighbors identified from untreated C32 controls. The public KG supplies AT7519-CDK1 and an unsigned CDK1-FOS association. The correct up-regulation prediction cites the response packets and KG relation. Its explanation distinguishes directional support from response evidence and contextual support from the unsigned KG association, keeping observed responses, model estimates, and biological annotations identifiable (Appendix B.4).
Together, these analyses support biologically relevant response recovery and traceable mechanistic interpretation. Computational inference and targeted experimental validation play complementary roles in mechanism discovery, as illustrated by CellOracle (Kamimoto et al., Nature, 2023), which combines network-based perturbation predictions with experimental validation. Our contribution to mechanism discovery is an evidence-linked computational approach to formulating biologically grounded, query-specific hypotheses.
Q3. Hallmark comparisons and consistency of transfer benefits
The aggregate results and the two Appendix F.4 comparisons concern different evaluation scopes or comparators and need not yield the same ranking. The 128 entries concern Hallmark-restricted cross-perturbation DIR prediction. The 88/125 result concerns cross-cell-line prediction against drug-and-gene-matched voting, whereas Figure 3(a) uses perturbation-independent Prior vote.
- Cross-perturbation comparison. The 128 entries are eligible Hallmark gene-set/cell-line pairs across five cell lines, selected using the query, gene, and drug coverage criteria in Appendix F.4. Each covers 10-75 distinct queried genes, potentially under multiple drugs. Hallmark sets overlap, so genes and queries contribute to multiple entries; the entries are neither independent experimental replicates nor an exhaustive, disjoint partition of the test set. Their lower DIR accuracy relative to Prior vote concerns these specified subsets. Section 3.2 instead evaluates overall and macro-per-gene performance across the complete test set. These different scopes need not produce the same ranking: the gene-set comparisons characterize performance within particular biological processes.
- Cross-cell-line comparison. Section 3.5, Figure 3(a), reports higher DIR accuracy in 128 of 130 eligible entries against Prior vote, which pools each gene's responses across perturbations in the four source cell lines, independently of the query drug. The additional comparator in Appendix F.4 votes over source responses matched to both the query drug and gene. The 88 negative differences among 125 entries refer to this drug-specific comparator; its available-query subset also differs from that used for Prior vote.
The complete-test-set evaluation summarizes overall and macro-per-gene performance, while the Hallmark analyses characterize performance within specified biological processes. Both cross-cell-line comparisons evaluate DIR accuracy, but use different source responses for voting and different query subsets. They therefore describe performance relative to distinct response-based references, rather than opposite outcomes against the same baseline on identical queries.
We have clarified the evaluation scopes and comparators of these process-level analyses in the revised manuscript (Appendix F.4).
Response to Reviewer rp1M
Thank you again for your valuable feedback and for taking the time to review our work. We wanted to kindly follow up on our previous response to ensure we have addressed your main concerns. Please let us know if you have any further questions or need additional clarifications. We remain committed to improving the paper.
Response to Reviewer rp1M [Part 1]
Thank you for recognizing the motivation and predictive effectiveness of our framework. Below, we validate the factorized response memory, discuss the evidence supporting mechanistic hypotheses, and clarify the scope of the Hallmark analyses.
Q1. Direct validation of the factorized response memory
The added analysis supports reproducible cell–gene tendency estimates and a learned structured response that is predominantly perturbation-dependent and recovers held-out gene-by-perturbation variation. These component-level results complement the predictive ablations.
Design rationale
General gene-response tendencies can support strong aggregate performance without distinguishing perturbations for the same target gene (CORE). We therefore estimate the stable cell–gene tendency αcg as the median training expression effect and hold it fixed during factorization. Broad perturbation effects account for shifts shared across genes, while the learned structured response WHc⊤ models gene-by-perturbation variation. Centering the gene loadings gives the structured response zero mean across genes for each perturbation, separating it from the broad perturbation effect (Section 2.2; Appendix A.2).
Direct validation and measures
We performed masked-response reconstruction with five random holdout splits within each cell line's response-memory fitting partition, using all 2,000 genes and recorded perturbations in each of the five cell lines. In each repetition, we randomly withhold 30% of the entries in each perturbation column of the gene-by-perturbation response matrix and refit the memory on the remaining 70% using the reported ranks and penalties.
Table R2. Component-level validation of the factorized response memory.
Perturbation dependence of the learned structured response. Before double-centering, we also measure the perturbation-independent component of WHc⊤, formed by repeating each gene's mean structured response across perturbations. It accounts for 1.93%-4.22% of the total squared magnitude of WHc⊤, with fractions averaged over repetitions within each cell line. This assesses the perturbation-independent component remaining in the learned structured response before evaluation removes additive effects.
Interpretation. Table R2 shows consistent cell–gene tendency rankings across disjoint response subsets. The structured response recovers gene-by-perturbation variation with less than half the held-out squared error of predicting no such variation. Together with the small perturbation-independent component measured before double-centering, these results support the intended approximate decomposition into stable cell–gene tendencies and perturbation-dependent structured responses.
We have added this validation, its protocol, and analysis to the revised manuscript (Appendix F.5, Table S14; Section 3.6).