- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes CellScientist, a feedback-driven workflow for revising cellular perturbation predictors. It combines revision history, task constraints, and discrepancy-based routing, and evaluates both revision behavior and the predictive utility of discovered models.
Critical strengths
-
Practical problem formulation. The paper addresses how to translate execution and validation feedback into targeted revisions of interacting model components while respecting task constraints.
-
Diverse evaluations. Experiments cover morphology, transcriptomic, and single-cell prediction, alongside controlled routing comparisons and external refits of frozen architectures. The discovery results on CPG0016 show substantial improvements over the listed baselines.
Critical weaknesses
-
Uneven gains and limited external benefits. In Table 28, PCC gains on BBBC036/047 over the strongest competing baselines range from 0.0072 to 0.0214, smaller than those on CPG0016. In the separate LKCP evaluation (Table 4), the BBBC036-derived architecture has lower PCC than RealMLP (0.1449 vs. 0.1496) and only a 0.25% MSE reduction. The BBBC047-derived architecture improves PCC to 0.1766 but has worse MSE and R².
-
Unclear incremental value of LLM selection. The controlled routing experiments jointly evaluate predefined diagnostic ranking, candidate preferences, and LLM selection. Similar results from Gemini 3 Pro and Qwen2.5-0.5B-Instruct within this restricted setting do not establish the LLM’s added value beyond the predefined heuristics.
Questions for authors
-
How should the mixed LKCP results be interpreted in terms of the practical predictive value of the discovered architectures?
-
How much of the controlled routing improvement is attributable to predefined heuristics, and what additional benefit does LLM selection provide?