- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This manuscript presents a antibacterial peptide activity prediction framework named STAMP, which takes peptide sequences and target bacterial species as inputs to predict the minimum inhibitory concentration (MIC). The model combines the micro-tuned ESM-2 sequence representation, the LDA topic representation constructed based on overlapping amino acid quadruplets, and species one-hot encoding. Through a shared regression network, it predicts the antibacterial activity under different species conditions. The authors conducted performance comparisons and ablation experiments on three public benchmarks and a self-built dataset and selected 18 candidate sequences from approximately 70000 computationally generated sequences for experimental verification. Additionally, the manuscript examines the model's response to changes in species conditions and the sequence regions relied upon for prediction through TP4-derived peptide analysis and residue gradient attribution, aiming to evaluate the feasibility of the unified model for predicting the activity of multi-species antibacterial peptides and candidate screening.
Critical strengths
This study addressed an interesting issue that the activity of antimicrobial peptides varies with the target species. It used a shared model to predict the MIC values for multiple species, which potentially has the value of reducing the repetitive modeling and maintenance work for each species. The method combines pre-trained sequence representations with local sequence statistical features, has a relatively simple structure, and is convenient for implementation and component analysis. The experiments covered datasets of different species scales and reported the species-specific results, providing a basis for evaluating the model's performance under different data conditions. Additionally, the authors clearly stated that LDA only fits on the training sequences and discussed the limitations such as prediction for unknown species, differences in experimental conditions, and handling of MIC annotations, which helped to define the scope of the method's applicability.
Critical weaknesses
- The author performs species merging at the data level for joint training, which may result in the training set and test set not being mutually exclusive at the global sequence level, namely two records corresponding to one peptide may respectively enter the training set and test set. This can be used to examine the activity completion of known peptides on another target, but it is a different task from predicting new peptides that have never been seen before. The author should report the intersection of training-validation-test sequences after merging all species, as well as the maximum sequence similarity distribution of test peptides to the training set. After dividing according to global sequences and homologous clusters, does the advantage of STAMP still hold? Do the existing results measure the generalization of new peptides or the cross-target activity completion of known peptides?
- The model adopted by the author is very simple. Simple methods can indeed be valuable. However, when the algorithm itself is relatively conventional, rigorous experiments are even more necessary to prove new and generalizable findings. Currently, the explanatory power of the method exceeds the experimental evidence and the claimed contributions. Apart from conventional feature concatenation and conditional feedforward networks, what are the unique contributions of STAMP's method? Where is the necessity of LDA compared to simple local sequence features? Which independent evidence can support the explanations of "functional motifs" and "biological context", rather than just species identity conditioning and the utilization of sequence similarity?
- Table 1 clearly labels the baseline as "average across species", while STAMP is labeled as "across species". The manuscript does not clearly state whether the two use the same method for aggregating indicators. The total MAE index calculated based on the self-built dataset's data volume for each species provided in Table 5 and the MAE index for each species provided in Table 9 does not match the 0.285 reported in the manuscript. The authors need to clarify and explain the reason. Additionally, the authors did not provide confidence intervals and results from multiple runs. After these issues are clarified, will the main performance conclusions still be held?
- Among the 18 candidates, most showed strong activity, which was indeed a positive result. However, the authors did not provide random candidate controls from the same generation library or other method-based control groups. Therefore, it is impossible to determine whether the high hit rate mainly comes from the generation library itself, or whether STAMP has brought additional enrichment.
- The proposed is not compared with the recent published methods, so it is difficult to evaluated whether the results obtained by the proposed method are SOTA.
Questions for authors
- The author performs species merging at the data level for joint training, which may result in the training set and test set not being mutually exclusive at the global sequence level, namely two records corresponding to one peptide may respectively enter the training set and test set. This can be used to examine the activity completion of known peptides on another target, but it is a different task from predicting new peptides that have never been seen before. The author should report the intersection of training-validation-test sequences after merging all species, as well as the maximum sequence similarity distribution of test peptides to the training set. After dividing according to global sequences and homologous clusters, does the advantage of STAMP still hold? Do the existing results measure the generalization of new peptides or the cross-target activity completion of known peptides?
- The model adopted by the author is very simple. Simple methods can indeed be valuable. However, when the algorithm itself is relatively conventional, rigorous experiments are even more necessary to prove new and generalizable findings. Currently, the explanatory power of the method exceeds the experimental evidence and the claimed contributions. Apart from conventional feature concatenation and conditional feedforward networks, what are the unique contributions of STAMP's method? Where is the necessity of LDA compared to simple local sequence features? Which independent evidence can support the explanations of "functional motifs" and "biological context", rather than just species identity conditioning and the utilization of sequence similarity?
- Table 1 clearly labels the baseline as "average across species", while STAMP is labeled as "across species". The manuscript does not clearly state whether the two use the same method for aggregating indicators. The total MAE index calculated based on the self-built dataset's data volume for each species provided in Table 5 and the MAE index for each species provided in Table 9 does not match the 0.285 reported in the manuscript. The authors need to clarify and explain the reason. Additionally, the authors did not provide confidence intervals and results from multiple runs. After these issues are clarified, will the main performance conclusions still be held?
- Among the 18 candidates, most showed strong activity, which was indeed a positive result. However, the authors did not provide random candidate controls from the same generation library or other method-based control groups. Therefore, it is impossible to determine whether the high hit rate mainly comes from the generation library itself, or whether STAMP has brought additional enrichment.
- The proposed is not compared with the recent published methods, so it is difficult to evaluated whether the results obtained by the proposed method are SOTA.
5 comments
Response to Reviewer E31n Question 2
Reviewer E31n Q2. The model adopted by the author is very simple. Simple methods can indeed be valuable. However, when the algorithm itself is relatively conventional, rigorous experiments are even more necessary to prove new and generalizable findings. Currently, the explanatory power of the method exceeds the experimental evidence and the claimed contributions. Apart from conventional feature concatenation and conditional feedforward networks, what are the unique contributions of STAMP's method? Where is the necessity of LDA compared to simple local sequence features? Which independent evidence can support the explanations of "functional motifs" and "biological context", rather than just species identity conditioning and the utilization of sequence similarity?
RESPONSE: We thank the reviewer for this comment. We agree that simple methods require rigorous experimental support, and we believe our revised manuscript provides this.
Regarding the unique contributions of STAMP: the contribution is not feature concatenation itself, but the formulation and evaluation of antimicrobial activity as a context-dependent property of the peptide-target pair, operationalized through a unified cross-species framework. Existing methods (LLAMP, Ensemble, ANIA) train separate models for each species, requiring 3-35 independent models. STAMP replaces this with a single shared model that conditions predictions on species identity while sharing sequence-activity relationships across targets. This is not merely a modeling convenience -- the cross-species formulation enables data-sparse species to benefit from shared patterns (Section 2.4, Eq. 8-9), as demonstrated by the largest performance gap between per-species baselines and STAMP occurring on Dataset A (35 species, many with limited data).
Regarding LDA vs. simple local sequence features: LDA topic mixture probabilities are fundamentally different from frequency-based features such as k-mer counts or TF-IDF. TF-IDF weights individual k-mers independently based on occurrence frequency. LDA learns latent co-occurrence patterns among 4-mers and represents each peptide as a probability distribution over latent topics, where each topic captures a group of co-occurring motifs. The output is a compositional summary (probabilities summing to 1) that captures higher-level motif structure, not a frequency vector of individual patterns.
The biological relevance of LDA-derived motifs has been independently established in the literature. Padi et al. (Scientific Reports, 2025) demonstrated that:
- LDA-derived topic motifs are associated with physicochemical properties relevant to antimicrobial activity, including isoelectric point, hydrophobic moment, hydrophobicity, and structural characteristics.
- LDA-derived motifs differ from conventional frequency-based motifs in diversity, redundancy, and biochemical interpretation.
- Topic-derived motif groups capture recurring co-occurrence patterns that correspond to biologically meaningful peptide characteristics.
Building on this independently established evidence, STAMP incorporates LDA topic-mixture representations into species-conditioned MIC prediction. Table 4 provides predictive evidence within the STAMP framework: Sequence+Motif consistently outperforms Sequence-only across all four datasets in both per-species and cross-species settings, and STAMP outperforms Sequence+Species across all four datasets. These results demonstrate that motif-topic information contributes predictive value beyond sequence embeddings and species identity alone.
The species-conditioned analysis (Section 3.4, Table 3) and residue-level attribution (Section 3.5, Figure 2) provide additional evidence that the model captures target-dependent activity differences consistent with known Gram-negative and Gram-positive membrane properties, rather than merely utilizing species identity as a categorical label.
- Padi, S., Mondal, K., Hoogerheide, D.P. et al. AI-driven antimicrobial peptide characterization unveils novel motifs for drug design. Sci Rep 16, 829 (2026). https://doi.org/10.1038/s41598-025-30419-1
Response to Reviewer E31n Question 3
Reviewer E31n Q3. Table 1 clearly labels the baseline as "average across species", while STAMP is labeled as "across species". The manuscript does not clearly state whether the two use the same method for aggregating indicators. The total MAE index calculated based on the self-built dataset's data volume for each species provided in Table 5 and the MAE index for each species provided in Table 9 does not match the 0.285 reported in the manuscript. The authors need to clarify and explain the reason. Additionally, the authors did not provide confidence intervals and results from multiple runs. After these issues are clarified, will the main performance conclusions still be held?
RESPONSE: We thank the reviewer for identifying these issues and apologize for the lack of clarity.
Metric aggregation: The distinction between "average across species" and "across species" in Table 1 refers to the modeling strategies, not the metric computation. LLAMP, Ensemble, and Attention-based methods employ species-specific models, whereas STAMP trains a single unified model. For all methods, we employ micro-averaging: MSE, MAE, R2, and PCC are computed directly from the pooled measured and predicted MIC values across all test samples. We have revised the Table 1 column headers and caption for clarity.
MAE discrepancy: Upon re-examination, we identified and corrected an error in the reported per-species metrics in the original Table 9. The corrected values (Table 15 in the revised manuscript) are now consistent with the overall STAMP results computed via micro-averaging.
Confidence intervals: We conducted five independent evaluations across all four datasets and report mean and standard deviation in Table 5. STAMP achieves mean PCC values of 0.723 +/- 0.010, 0.692 +/- 0.007, 0.788 +/- 0.004, and 0.824 +/- 0.013 across the four datasets, respectively. Although the mean performance on Dataset B (PCC: 0.692) is lower than the original single-run result (PCC: 0.758), results for Datasets A, C, and our curated dataset remain consistent with the original findings.
The main performance conclusions hold: STAMP provides a unified cross-species MIC prediction framework with competitive performance, consistently achieving PCC > 0.69 across all datasets over multiple runs, without requiring independently trained models for each species. The additional sequence-disjoint evaluations (Table 6) further demonstrate that STAMP maintains PCC > 0.70 for previously unseen peptide sequences.
Response to Reviewer E31n Question 1
Reviewer E31n Q1. The author performs species merging at the data level for joint training, which may result in the training set and test set not being mutually exclusive at the global sequence level, namely two records corresponding to one peptide may respectively enter the training set and test set. This can be used to examine the activity completion of known peptides on another target, but it is a different task from predicting new peptides that have never been seen before. The author should report the intersection of training-validation-test sequences after merging all species, as well as the maximum sequence similarity distribution of test peptides to the training set. After dividing according to global sequences and homologous clusters, does the advantage of STAMP still hold? Do the existing results measure the generalization of new peptides or the cross-target activity completion of known peptides?
RESPONSE: We thank the reviewer for highlighting the important distinction between generalization to unseen peptide sequences and prediction of unseen peptide-species combinations.
Dataset A already employs sequence-disjoint partitions, with 9,181 unique peptide sequences distributed across training, validation, and test sets (7,344/918/919), ensuring zero sequence overlap after merging all species. Datasets B, C, and our curated dataset originally employ peptide-species pair-disjoint partitions, which evaluate prediction of previously unobserved peptide-species combinations but may contain identical peptide sequences-species pairs across partitions.
To directly address this concern, we conducted sequence-disjoint evaluations for Datasets B, C, and our curated dataset (Table 6), grouping all measurements of the same peptide sequence into a single partition and ensuring zero exact sequence overlap across training, validation, and test sets. Five distinct partitions were generated using different random seeds. Under sequence-disjoint evaluation, STAMP achieves mean PCC values of 0.723, 0.707, 0.706, and 0.718 across the four datasets, respectively, consistently maintaining PCC > 0.70 for previously unseen peptide sequences.
Our evaluations therefore address both tasks the reviewer distinguishes:
Both evaluation settings demonstrate competitive predictive performance, and the manuscript now explicitly distinguishes these objectives (Table 11).
Furthermore, our prospective experimental validation provides the strongest evidence of generalization: 15 computationally generated peptides with no overlap with any training data were synthesized and tested, with 14/15 exhibiting MIC < 10 uM against E. coli and 15/15 against S. epidermidis (Table 2). This prospective validation on entirely novel peptide sequences cannot be attributed to memorization or sequence overlap.
We acknowledge that homology-cluster-disjoint evaluation would provide additional insight into generalization to more distant regions of peptide sequence space, and we identify this as a direction for future work.