- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents PlantBGC, a three-stage framework for transferring BGC representations from microbes to plants under limited plant supervision. The framework combines supervised training on microbial BGCs, masked language modeling on unlabeled plant sequences, and weakly supervised calibration using GO/KEGG-derived annotations. The paper evaluates the approach on curated plant BGCs, including comparisons under controlled screening budgets and leave-one-species-out evaluation.
Critical strengths
- The paper addresses a practical and important setting: experimentally validated plant BGC annotations are scarce, while microbial annotations and unlabeled plant genomic data are more readily available.
- The reported improvements after plant-domain adaptation are promising. Controlling genomic coverage and candidate counts strengthens the evidence that these improvements are not solely due to nominating more genomic regions.
Critical weaknesses
- Positioning and clarity. Although prior studies are cited in the introduction, the paper lacks a focused discussion of related work that clearly distinguishes its contributions from existing BGC representation learning and domain adaptation methods. This makes the methodological positioning difficult to follow.
- Limited technical novelty. The framework largely combines established techniques, including supervised sequence classification, MLM-based domain adaptation, and weak supervision. In particular, adapting representations through MLM on unlabeled target-domain data is a conventional approach. The current comparisons and ablations do not sufficiently establish the benefits of the specific training sequence and freezing strategy over simpler alternatives or similarly adapted existing BGC models.
- Insufficient independent validation of Stage 3. GO/KEGG-derived proxies are used both to construct the weak supervision and to evaluate calibration. Although the paper acknowledges their limitations, improvements in these metrics do not establish a genuine reduction in BGC false positives. The authors should compare Stage 3 against a continuous rule-based rescoring baseline under matched screening budgets and assess candidate quality using independent annotations or blinded expert evaluation.
Questions for authors
- What distinguishes PlantBGC from applying standard MLM-based domain adaptation to an existing BGC representation model such as BiGCARP?
- How sensitive are the results to the training order and freezing strategy, and do these choices outperform simpler alternatives under comparable training budgets?
- Can the authors validate Stage 3 using evidence independent of the GO/KEGG proxies and compare it with continuous rule-based rescoring under matched screening budgets?
4 comments
Reminder to engage in discussion period
Hi Skmc,
As there are only two days left in the author-reviewer discussion period, I would like to remind you to kindly respond to the authors' rebuttal, posted last week. After November 18, reviewer responses are not be allowed and you will no longer be able to ask any follow-up questions. If you have no follow-ups, a short and polite response acknowledging you have read and understood the rebuttal and have no further questions is sufficient.
Thanks, AC
Revised Manuscript Uploaded for Rebuttal
Thank you again for your careful evaluation and constructive feedback.
We have now uploaded a revised version of our manuscript, incorporating the revisions, clarifications, and additional experiments discussed in our rebuttal. All relevant changes have been highlighted in blue to facilitate review.
In particular, we have made the following updates in response to your concerns:
- Positioning and technical novelty: We expanded the Introduction and added a dedicated Related Work section with a comparative table in Appendix A, clarifying how PlantBGC differs from existing microbial BGC models and plant-specific discovery tools.
- Additional baseline comparisons: We incorporated new DeepBGC and BiGCARP direct-transfer experiments, as well as BiGCARP plant-only MLM results, into Section 3.2 (Table 2). These comparisons further illustrate the challenges of direct microbial-to-plant transfer and plant-only self-supervised learning.
- Ablation studies: We expanded the discussion of the training stages and freezing strategy, including additional freezing-ratio ablation results in Appendix I (Table 11).
- Stage 3 evaluation: We clarified the distinction between GO/KEGG-derived proxy-based calibration and genuine biological false-positive reduction in Section 3.3. We also acknowledge that the existing co-expression analysis provides complementary biological evidence but does not independently isolate Stage 3's contribution.
We hope these revisions provide a clearer presentation of our methodological contributions, additional experimental evidence, and the limitations of our current evaluation.
We sincerely appreciate your time and consideration, and we would be grateful for any further feedback on the revised manuscript.
Thank you for your response, which partially addressed my problem. Considering the novelty and scope of the paper, I would like to adjust my scores to 2.
Reply to Critical Weakness 3 and Questions to author
Critical Weakness (tbc)
3. Insufficient independent validation of Stage 3.
Thank you for this valuable suggestion. We agree that GO/KEGG-derived proxy metrics cannot independently establish a reduction in genuine BGC false positives. An important distinction is that Stage 2 performs Pfam-level scoring and subsequently aggregates high-scoring regions into candidate BGCs, whereas GO/KEGG-derived primary-like confidence scores are calculated at the aggregated BGC level. Therefore, directly rescoring candidates using GO/KEGG can adjust their final scores or rankings, but it does not update the underlying Pfam-level representations or scoring function.
Furthermore, GO/KEGG annotations provide imperfect functional evidence. A primary-like candidate is not necessarily a false positive, while mixed and review candidates may still contain biologically relevant information. Hard filtering therefore risks discarding potentially useful BGCs, and continuous rescoring also requires selecting an appropriate suppression strength and threshold.
Our existing experiments already include a rule-only filtering baseline (Section 3.3, Table 2). Under GO, rule-only filtering removes all explicitly primary-like candidates but leaves the residual primary-like burden at 21.45%, compared with 6.12% after Stage 3. Under KEGG, the corresponding values are 12.63% and 2.12%. Importantly, Stage 3 preserves the recovery of the 34 curated reference BGCs, including 23/34 (67.6%) under strict 100% coverage.
For independent biological evidence, Section 3.5 additionally reports RNA-seq-based co-expression analysis using ATTED-II, which does not rely on GO/KEGG-derived weak supervisory labels.
Questions for Authors
1. Distinguishment of PlantBGC:
Please refer to our detailed response to Weakness 2 (Limited technical novelty). In brief, unlike BiGCARP, PlantBGC integrates microbial supervised learning, constrained MLM-based plant-domain adaptation, and GO/KEGG-guided weak supervision to preserve and refine BGC-discriminative knowledge. Our additional experiments show that BiGCARP achieves 29.4% Any-overlap recovery under direct transfer and 11.8% with plant-only MLM training, compared with 76.5% for PlantBGC Stage 1 and 100% for the complete framework.
2. Ablation study:
Thank you for this question. Please also refer to our response to Weakness 2 (Limited technical novelty) for comparisons with simpler alternatives, including DeepBGC and BiGCARP. Our existing experiments in Figure 2 already evaluate the contributions of different training stages and their robustness under matched screening budgets and leave-one-species-out (LOSO) evaluation. The results are reported in the order Any overlap / ≥50% / ≥80% / 100% coverage: • Stage 1: 76.5% / 52.9% / 35.3% / 29.4%. • Stage 2: 100% / 97.1% / 76.5% / 67.6%. • Stage 3: 100% / 97.1% / 76.5% / 67.6%. • Stage 3 (matched budget): 100% / 97.1% / 70.6% / 58.8%. • Stage 3 (LOSO): 94.1% / 85.3% / 61.8% / 58.8%. These results demonstrate that Stage 2 substantially improves recovery over Stage 1, while Stage 3 preserves known-BGC recovery and further reduces GO/KEGG-derived primary-like evidence, as shown in Table 2. The matched-budget and LOSO results also demonstrate that the recovery advantage is retained under controlled candidate-screening budgets and unseen-species evaluation. To further evaluate the sensitivity to the freezing strategy, we conducted additional ablation experiments: • 0% frozen: 26.5% / 20.6% / 11.8% / 8.8%. • 50% frozen: 82.3% / 58.8% / 47.1% / 38.2%. • 80% frozen: 100% / 97.1% / 76.5% / 67.6%. These results show that freezing 80% of the encoder substantially improves recovery compared with freezing 0% or 50%, supporting the importance of preserving source-domain representations during plant-domain adaptation.
3. GO/KEGG Validation
Please refer to our detailed response to Weakness 3 (Insufficient independent validation of Stage 3). In brief, our existing experiments already include a rule-only filtering baseline (Section 3.3, Table 2). While direct filtering removes explicitly primary-like candidates, it leaves the residual primary-like burden unchanged at 21.45% (GO) and 12.63% (KEGG). In contrast, Stage 3 reduces these values to 6.12% and 2.12%, respectively, while preserving known-BGC recovery. Furthermore, Section 3.5 provides independent RNA-seq-based co-expression evidence using ATTED-II. However, we acknowledge that the existing rule-only baseline does not constitute a continuous rescoring comparison under matched screening budgets, and that the co-expression analysis does not directly isolate Stage 3's contribution.