- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
In this manuscript, the authors present the Expression Predictability Score (EPS), a model-agnostic metric for quantifying the predictability of gene expression from histology images. The proposed EPS measures the consistency of gene expression within neighbourhoods defined by pretrained image embeddings, using a normalised graph Laplacian energy formulation. The extensive experimental results demonstrate the association between EPS and empirical prediction performance.
Critical strengths
- This manuscript presents an interesting and useful problem formulation that examines how prediction difficulty varies across genes and tissues, rather than solely proposing a framework for predicting gene expression.
Critical weaknesses
-
The novelty of EPS proposed by this manuscript is insufficiently distinguished from existing statistics. Substituting Eq. (1) into Eq. (2) shows that is exactly Geary’s C, evaluated on the image-embedding graph; EPS is its negative logarithm. The manuscript discusses Laplacian Score but does not acknowledge this exact equivalence. Applying this statistic to cross-modal predictability may be useful, but the authors need to clarify what is new beyond the application and empirical evaluation.
-
The evaluation in this manuscript does not really establish that the proposed EPS can predict performance on independently held-out data. EPS is computed using expression values from the entire tissue section, including the test locations, whereas model performance is evaluated on an 80% and 20% within-slice split. This does not demonstrate that a score computed from available training data can reliably guide target selection for unseen observations.
Questions for authors
-
I suggest the authors clarify further on the contribution of this manuscript. What is the principal advance beyond this statistic and the cited Laplacian Score: the application, theoretical interpretation, aggregation, or empirical findings?
-
How is the generalizability of the proposed method? Please include additional experiments to evaluate performance on independently held-out data instead of the within-slice split.