- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1(−2)
- Soundness
- 2
Read review
Paper summary
GOA-PGN predicts log-transformed minimum inhibitory concentration (MIC) for antimicrobial peptides. A peptide-tuned ESM-2 supplies residue embeddings, partial 1D convolutions refine local sequence patterns, and a graph aggregates these features using positive cosine similarities between ESMFold-derived side-chain orientations. Attention pooling and SE-equipped heads predict MIC, potency class, charge, and hydropathy. Training uses a frozen-backbone warm-up followed by joint fine-tuning and threshold-based upweighting of potent examples. Evaluation covers three DBAASP bacterial species and CAMP E. coli, with five homology-aware splits. The model improves several regression metrics, particularly on DBAASP E. coli, but ranking gains are not consistent across all high-potency subsets.
Critical strengths
- Quantitative MIC estimation and potent-peptide ranking are more useful for screening than AMP classification, and the QMAP split below 60% identity, five split evaluations and separate high-potency reporting guard against overly favorable random splits.
- GOA-PGN beats the closest baselines on DBAASP E. coli (Spearman 0.549 and RMSE 0.646 versus LLAMP’s 0.514 and 0.679) and on the high-potency subset (0.313 and 0.697 versus MBC-Attention’s 0.277 and 0.727).
Critical weaknesses
- The sequence and structure fusion idea is not new, since ANIA, AMPredictor and GGN-ABPMIC already combine local, global and graph information for MIC prediction, the last two are missing from the comparison tables, and without matched comparisons against other graph designs the orientation-only adjacency is not shown to be an advance.
- The central claim is under-validated, because cosine similarities still depend on a predicted conformation, the linked models.py uses exp(-dist / 3.0) * relu(cos_sim) rather than the distance-free Eqs. 4 to 7, and the generalization claims do not hold uniformly (LLAMP has the higher Spearman on high-potency CAMP, 0.303 versus 0.288), so I recommend 1: clear rejection.
Questions for authors
- What is the essential advance over AMPredictor and GGN-ABPMIC, can they be compared under identical cleaning, MIC transformation, homology splits and tuning budgets, and which existing controls isolate orientation-based adjacency from simply adding graph aggregation to the same backbone?
- Which code and configuration produced each main and appendix result, how do the released exp(-dist / 3.0), the distance-free Eqs. 4 to 7 and Appendix D’s constant 8.0 reconcile, and was model selection done without access to test results?
- What direct evidence supports robustness to conformational noise or membrane-relevant amphipathicity, such as perturbation, structure-confidence, alternative-graph or orientation-shuffling analyses, and should invariance to a common rotation be distinguished from robustness to internal conformation changes?
- Please report high-potency test counts and paired per-split differences, say whether CAMP was trained or tuned separately and how cross-database duplicates were handled, and clarify that the “dynamic” DIR weights in Eq. 11 are fixed thresholds.
The authors have partially addressed my concerns, but the presentation of the work remains unclear. For example, Figure 4 does not clearly demonstrate which components contribute most to the overall performance. Furthermore, the paper uses multiple definitions of α, referring to both attention scores and hyperparameters, which creates confusion. The sensitivity analysis of the hyperparameters is also missing, as is an ablation study of the deep imbalanced regression component. These omissions make it difficult to assess the key contributions and effectiveness of the proposed method. Therefore, I maintain my original score of 1.