- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents PepSeek, a coarse-to-fine framework for peptide–receptor recognition and candidate screening. The proposed workflow combines hierarchical molecular graph representation learning, receptor-specific adaptation, and accelerated complex structure prediction to rank and prioritize candidate peptides. The authors construct P1, a benchmark based on cold-chemical-series splitting, and evaluate the method across five activity prediction tasks and 16 GPCRs. The workflow is further assessed through structural enrichment analysis, AF-turbo runtime comparisons, and cellular functional assays.
Critical strengths
The paper is generally well organized, with a clear motivation and a practically relevant screening workflow. The authors integrate molecular activity prediction, structural evaluation, and cellular experiments, providing a relatively broad evaluation that connects computational predictions with biological validation.
The P1 benchmark adopts a chemical-series-based splitting strategy that also accounts for repeated measurements and peptide–receptor pair identities, offering a more rigorous evaluation protocol than conventional random splitting. In addition, AF-turbo substantially reduces computational time while maintaining comparable structural prediction quality. The cellular assays also identify peptides with concentration-dependent responses, demonstrating the potential practical value of the workflow.
Critical weaknesses
The methodological novelty is not sufficiently established. The core graph architecture of PepSeek closely resembles the existing PSICHIC framework, including molecular and receptor graph representations, hierarchical graph processing, and cross-entity attention. The model is also initialized from the pretrained PSICHIC checkpoint. Although the authors introduce task-specific adaptation and a new screening workflow, the manuscript does not clearly distinguish the proposed interaction mechanism from the original PSICHIC architecture. Moreover, the absence of controlled ablation studies makes it difficult to determine the independent contributions of the proposed components.
The main performance comparison has a significant limitation. The best results in Table 1 are obtained from a metric-specific oracle whose ensemble weights are fitted using the test labels, rather than from a predictor selected independently of the test set. Although the authors explicitly acknowledge that this is a diagnostic upper bound, the main comparison does not report the actual test performance of the validation-selected eight-seed ensemble. Consequently, the reported results do not sufficiently establish that PepSeek outperforms existing methods under an independent evaluation setting.
The baseline comparisons and ablation studies are insufficient. In Table S2, a simple sequence-nearest-neighbor baseline reaches a median Spearman ρ of 0.3805, which is higher than the best adapted PepSeek setting (selected initialization) at 0.3155, but this result receives limited discussion. Furthermore, the reference models largely retain their frozen pretrained weights, whereas PepSeek undergoes task-specific adaptation. This makes it difficult to distinguish improvements arising from architectural design from those attributable to additional training. The paper also lacks a direct comparison with the original PSICHIC under matched training conditions and systematic ablations of the key architectural components and training strategies.
Questions for authors
- Table 1 reports oracle ensembles optimized using test labels. Could the authors provide the actual RMSE and Spearman correlation of the eight-seed ensemble, selected entirely using training and validation data, on the P1 test sets, and compare these results against the existing baselines?
- The core architecture of PepSeek appears highly similar to PSICHIC. Could the authors clarify the specific differences between the proposed interaction mechanism and the original PSICHIC architecture? Could they also provide a controlled comparison with PSICHIC under identical training and evaluation conditions, together with ablations of the key architectural components?
- In Table S2 the sequence-nearest-neighbor baseline ranks better than the adapted model on both the median (0.3805 vs. 0.3155) and the mean (0.3741 vs. 0.3611) Spearman ρ. How do the authors explain this observation? Additionally, could the main baselines be evaluated under the same data splits and task-specific adaptation settings to provide a more direct assessment of the proposed method's improvements?
- In section 6.4, the 6.22-fold enrichment is based on AlphaFold's ipTM rather than experimentally validated binding. Could the authors quantify the correlation between PepSeek scores and ipTM, and provide independent evidence that this structural enrichment translates into improved biological hit rates?
3 comments
Please take a moment to respond the authors. Thank you!
Thank you for facilitating the discussion. We appreciate your time and coordination.
Response to Reviewer QsoC
Thank you for your review. To prioritize likely binders from large peptide libraries for a protein, we systematically refined PepSeek's data, architecture, training, and evaluation through protein multi-region and peptide multi-conformation representations.