- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a phenotype-associated gene ranking approach using frozen AlphaGenome representations. For each candidate gene, AlphaGenome predicts melanocyte RNA-seq tracks from individual haplotypes, and a separate CNN is trained to predict a binary pigmentation label from that gene's representation. The held-out balanced accuracy of each classifier is then used to rank genes.
The method is evaluated on 1,072 individuals from the 1000 Genomes Project, where African populations are labeled as strongly pigmented and European populations as weakly pigmented. On 9 literature-curated pigmentation genes and 33 screened controls, the proposed ranking achieves AUC 0.880 and outperforms variant-level GWAS rankings and several ablations, particularly near the top of the ranking. The authors argue that the AlphaGenome representation acts as a functional bottleneck that suppresses ancestry-associated variation without predicted transcriptional consequences.
Critical strengths
-
The functional bottleneck perspective is interesting. Rather than performing association directly on genotype, the method passes sequence variation through frozen, cell-type-specific AlphaGenome predictions. The ablations provide some evidence that this representation suppresses ancestry information that unrestricted sequence retains broadly.
-
The experimental protocol is relatively transparent. The paper reports top-of-ranking metrics, permutation tests, several representation ablations, and explicitly acknowledges important limitations such as the ancestry-derived phenotype, small positive set, and distinction between locus and causal gene.
Critical weaknesses
-
The phenotype is not actually measured. The binary pigmentation label is deterministically constructed from continental ancestry. Therefore, the experiment cannot distinguish pigmentation-specific signal from other biological signals that differ between African and European populations.
-
The per-gene score lacks a clear interpretation. A gene is scored by the held-out accuracy of a CNN predicting this ancestry-derived label from its AlphaGenome representation. High predictability does not imply phenotype-specific relevance or causal involvement of the gene.
-
The gene ranking may depend strongly on the downstream CNN, but does not establish that the ranking is stable across classifiers, optimization or resampled individuals. It is therefore unclear whether the ranking reflects a robust property of the AlphaGenome representation.
-
The benchmark may be unusually favorable to the proposed representation. The positives are known pigmentation genes, while controls are screened to exclude pigmentation, melanin, and melanocyte annotations. The proposed representation is specifically melanocyte RNA-seq.
-
The empirical comparison is limited. The evaluation contains only 9 positive genes and 33 controls from one cohort. The comparison also lacks a strong modern gene-prioritization baseline under a non-circular evaluation protocol.
-
The evidence supports locus prioritization more directly than gene discovery. A high-scoring gene-centered window does not identify the causal gene. The HERC2/OCA2 example illustrates this distinction.
-
The GWAS comparison represents a deliberately pathological setting. Population structure is identical to the constructed label, and the GWAS baseline is consequently evaluated without population-structure correction, but it does not support a general claim that the proposed approach is superior to established association-based approaches.
Questions for authors
-
What is the intended statistical or causal interpretation of per-gene classifier accuracy? Why should Y-predictability from an AlphaGenome track be interpreted as phenotype-specific gene relevance rather than label information retained at that locus? How stable is the ranking across alternative classifiers, seeds, and bootstrap resampling?
-
Can the authors evaluate on hard matched controls, such as genes with substantial melanocyte activity and ancestry differentiation but no established pigmentation role? This would help determine whether the method identifies phenotype relevance rather than simply distinguishing melanocyte/pigmentation genes from generic controls.
-
Can the method be evaluated on a measured phenotype where ancestry and phenotype are correlated but not deterministically identical? I consider this important for establishing the central claim beyond the constructed stress test.
-
Can the authors provide stronger gene-prioritization/functional-genomics baselines under a non-circular evaluation protocol? If this is impossible because existing methods use information involved in constructing the positive panel, please clarify the scope of the comparative claim.