- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates using limited perturbation measurements from a new donor to predict differential transcriptional responses across unseen perturbations. The authors propose the LHB response model alongside a staged learning framework. The architecture integrates shared perturbation representations, context-specific transformations, and a nonlinear decoder whose input coordinates are recoverable via linear projection. The theoretical analysis characterizes the specific information required to recover perturbation relationships, identify nonlinear query responses, and adapt to target donors. Across diverse experimental settings, evaluations on few-shot prediction and cross-context transfer demonstrate lower prediction errors compared to baselines that omit target perturbation responses. Controlled experiments further analyze how informational coverage across source datasets and target supports influences predictive performance.
Critical strengths
Strengths
- The paper clarifies what data to acquire when predictions fail. The theoretical analysis distinguishes the information needed for perturbation relationships, nonlinear responses, and target donor adaptation. Controlled experiments vary coverage of these information types to track changes in prediction error. These results separate measurement noise from informational deficiency, explaining why certain errors cannot be eliminated by simply adding replicate measurements.
- Experiments systematically examine the sources of empirical gains. Cell lines from the same donor are held out entirely to prevent donor overlap from inflating generalization estimates. The paired MSE difference against a compressed nonlinear predictor is −0.00197, with a 95% donor bootstrap interval of [−0.00319, −0.00080]. Comparisons across context transformations, decoders, and projection constraints validate key designs, while structural mismatch experiments identify conditions where the method fails.
Critical weaknesses
Weaknesses
- Diminishing gains when acquisition metrics are estimated independently. When selection metrics are independently estimated, the average improvement of S7 over S5-cal drops sharply from 0.000300 to 0.000030, with lower coverage of prediction intervals. Comparison intervals for reordering measurements contain zero under a fixed stopping rule. The acquisition tests also rely on a synthetic eight-dimensional benchmark. These results offer weak evidence for improved experimental design and leave a gap for real biological tasks.
- Unclear predictive gains over few-shot baselines and narrow evaluation scope. The 42% improvement comes from comparisons against baselines omitting target responses, while paired comparison intervals against HyperMap and PerturbMap contain zero. Experiments are limited to fixed pluripotency programs. Both the linear encoder and orthogonal complement decoder follow existing designs. These findings leave the incremental predictive value and broader generalizability of the model unconfirmed.
Questions for authors
Questions
- Confidence intervals and matched comparisons. Do the improvements of S7 over S5-cal and S6-cal hold when computing confidence intervals clustered by donor? How do these comparisons change under identical measurement budgets and under identical stopping rules?
- Empirical estimation and gain attribution. How much of the performance gain remains when relying solely on available measurements to estimate coordinates, noise, and expected candidate gains? Please disentangle how much improvement comes from selecting which targets to measure versus deciding when to stop measuring.