- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces a novel method to predict life boundary phenotypes - i.e. survival temperatures, survival pH ranges, oxygen tolerance etc. - from genomic data directly. Their method is GGBound - which takes a genomic sequence in, and outputs a phenotypic prediction: first, a genomic encoder (Evo2) is adapted to produce phenotype predictions directly, while also producing a latent representation that continues phenotype-relevant information. That latent representation is then adapted, via a projector, into the latent space of an LLM, which is then trained via SFT to create its own phenotypic predictions after reasoning about the phenotype. Next, these two predictions (the one from Evo2, and the one from the trained LLM) - called auxiliary predictions - are combined with the aforementioned genomic representation and all passed into a final LLM step ("Proposal-Conditioned Genomic Reasoning"), where the model reasons over all of them and outputs a final phenotype prediction. This final step is trained via GRPO, w/ added objectives to encourage reasoning beyond the provided auxiliary predictions. This entire pipeline combined substantially outperforms frontier LLMs and simpler baselines, setting a new SOTA for life-boundary phenotype prediction.
Critical strengths
- The paper's extremely complex pipeline is extremely well-justified. Each part of it is ablated, and it is thoroughly shown that the entire thing combined outperforms its component parts. Controls are offered in Table 2, w/ a detailed follow up in Table 5 showing how their method helps resolve conflicting predictions. Furthermore, the pipeline outperforms the simple baseline of frontier models.
- The paper introduces an ingenious new GRPO mechanism to encourage the model to genuinely use the information provided in the encoding and not just the auxiliary predictions - they measure, holding the aux predictions constant, whether changing the genomic encoding to a plausible distractor, on average, makes the overall rollout less likely. If so, the model was relying on the genomic encoding - and they increase the reward given to the rollout. This is a very important innovation - moving the ability to reconcile conflicting aux predictions from 63.4 -> 72.3, and boosts F1 accuracy from 0.645 on the Metabolism category of phenotype (the gains in the other types are smaller, but still in the right direction).
Critical weaknesses
None
Questions for authors
- You use Qwen3.5 9B and Qwen3.5 27B for the generation of the grounding reasoning traces, as I understand it. These models - especially Qwen3.5 9B - aren't particularly strong. Why not use a more powerful OSS model (GLM-5.2 or GLM-5.3, Kimi K3, etc.)? Cost reasons? Or does using a Qwen model help Qwen performance (as Qwen3.5-4B is your LLM decoder)?
- You state "The refined claims are subjected to deterministic validation before being included in the training set. We remove claims with invalid or missing evidence references, unsupported biological assertions, supervision leakage, or conclusions inferred
solely from missing annotations, ensuring that each retained statement remains traceable to the
provided protein evidence." Is there an easy way to do this programmatically? Rejecting "unsupported biological assertions" seems difficult - but I don't have a ton of domain knowledge in the realm of phenotype prediction, so perhaps there is. If you use simpler heuristics, adding a section to the appendix on how 'unsupported biological assertions' are rejected would be helpful. The rest of the rejection criteria make more sense - as they can be programmatically checked. If you mean 'unsupported biological assertions' in the sense of claims without a
support_level, state this explicitly - and emphasize you're applying format checking, not checking underlying biological validity. - Table 2 lacks p-values or confidence intervals - while it is clear your method is the best across phenotypes, whether or not the difference is statistically significant with runner-ups (i.e. E2-M or G/P-Qw.) isn't listed. Similarly, the grids in FIgure 5 could use annotations to indicate whether differences are statistically significant - as sometimes the gaps are quite close! Because your method clearly dominates all others in most cases, this isn't a huge concern - but it would be a nice addition, and one you could likely cheaply compute.
5 comments
Q3. Statistical Significance of Performance Improvements
A: We thank the reviewer for this valuable suggestion. We conducted 20,000 strain-level bootstrap resamples to estimate 95% confidence intervals (CIs) for performance differences, where Δ denotes the performance difference between GGBound and the corresponding baseline (GGBound − baseline).
As shown in the table below, for Table 2, GGBound's improvements have confidence intervals excluding zero on 12/17, 12/17, and 14/17 phenotypes compared with E2-M, G-Qwen, and P-Qwen, respectively. Furthermore, for Figure 5, all 15 comparisons between our full method and the three ablation variants have confidence intervals excluding zero, further supporting the contribution of each component. We have added these results to the Appendix D.1 and D.6 of revised manuscript.
| Group | Phenotype | Metric | Δ vs E2-M | Δ vs G-Qwen | Δ vs P-Qwen |
|---|---|---|---|---|---|
| Phys. Boundary | Temperature | RMSE | −0.197 [−0.418, -0.002] | −1.727 [−2.320, −1.150] | −1.867 [−2.913, −1.041] |
| pH | RMSE | −0.039 [−0.108, -0.010] | −0.186 [−0.266, −0.106] | −0.112 [−0.178, −0.047] | |
| Salinity | RMSE | −0.053 [−0.092, −0.023] | −0.805 [−1.071, −0.522] | −0.579 [−0.831, −0.321] | |
| Phys. Optimum | Temperature | RMSE | −0.449 [−0.672, −0.239] | −1.588 [−2.882, −0.504] | −1.370 [−2.692, −0.274] |
| pH | RMSE | −0.035 [−0.087, -0.008] | −0.327 [−0.414, −0.242] | −0.301 [−0.387, −0.217] | |
| Salinity | RMSE | −0.084 [-0.108,-0.01] | −0.674 [-0.87,-0.504] | −0.461 [-0.68,-0.24] | |
| Metabolism | Carbon Source | F1 | +0.008 [0.001, 0.017] | +0.053 [0.028, 0.079] | +0.168 [0.116, 0.221] |
| Electron Acceptor | F1 | +0.348 [0.120, 0.614] | +0.228 [0.094, 0.378] | +0.248 [0.114, 0.388] | |
| Electron Donor | F1 | +0.351 [0.073, 0.631] | +0.015 [0.00,0.056] | +0.075 [0.017, 0.138] | |
| Nitrogen Source | F1 | +0.226 [0.087, 0.352] | +0.339 [0.133, 0.555] | +0.290 [0.080, 0.515] | |
| Categorical | Oxygen Tolerance | Acc. (%) | +1.04 [0.00, 2.59] | +8.29 [3.11, 13.47] | +7.77 [3.63, 12.44] |
| Energy Type | Acc. (%) | +7.69 [0.00, 19.23] | +3.85 [0.00, 11.54] | +3.85 [0.00, 11.54] | |
| Morphology | Cell Shape | Acc. (%) | +8.74 [0.97, 16.50] | +11.65 [3.88, 19.42] | +6.80 [0.00, 14.56] |
| Motility | Acc. (%) | +1.50 [0.00, 3.50] | +9.50 [4.50, 14.50] | +27.00 [18.50, 35.00] | |
| Flagella | Acc. (%) | +4.60 [1.15, 9.20] | +4.60 [0.00, 11.49] | +1.15 [0.00, 3.45] | |
| Spore Formation | Acc. (%) | +1.01 [0.00, 2.51] | +2.01 [0.00, 4.52] | +42.71 [35.18, 50.25] | |
| Gram stain | Acc. (%) | +0.50 [0.00, 1.50] | +1.00 [0.00, 2.50] | +27.50 [21.50, 34.00] |
| Group | Improvement metric | Δ vs GRPO | Δ vs +Utility | Δ vs +CE |
|---|---|---|---|---|
| Physiological Boundaries | NRMSE | -0.006 [-0.011, -0.001] | -0.005 [-0.011, -0.001] | -0.004 [-0.01, -0.001] |
| Physiological Optima | NRMSE | -0.009 [-0.015, -0.002] | -0.005 [-0.01, -0.001] | -0.008 [-0.013, -0.003] |
| Metabolism | F1 | +0.179 [0.105, 0.255] | +0.183 [0.102, 0.269] | +0.162 [0.093, 0.236] |
| Categorical Physiology | Acc (%) | +4.85 [0.52, 11.03] | +1.04 [0.12, 2.36] | +2.70 [0.25, 4.74] |
| Morphology | Acc (%) | +3.65 [1.98, 5.42] | +2.38 [0.78, 4.08] | +3.22 [1.26, 5.30] |
[1] Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment, ACL 2026
We sincerely thank you again for your valuable time and constructive feedback, which have greatly improved the quality and clarity of our manuscript.
Thank you for the detailed response! As for Q1, I completely understand limited computational resources - that resolves my question!
As for Q2, thank you for clarifying this in the appendix. This resolves my concerns there!
We sincerely thank you for your valuable and positive comments. We hope our response below could address your concerns.
A: We thank the reviewer for this question. Our choice was primarily driven by limited computational resources, favoring efficient, locally deployed models. We use Qwen3.5-9B for initial reasoning generation and Qwen3.5-27B for evidence-grounded refinement. Regarding potential same-family bias, prior work [1] suggests that stronger teachers do not necessarily yield better reasoning distillation, as teacher–student compatibility also matters, potentially favoring same-family models. We have acknowledged this potential influence and clarified our model choice in the revised Appendix B.3.
A: We thank the reviewer for this helpful comment. We agree that automatically verifying biological claims is challenging, and our original wording was imprecise. Rather than relying on deterministic biological validation, we use Qwen3.5-27B to assess claims against the provided protein annotations, revising or rejecting those lacking sufficient evidence.
For example, a protein annotation in Flavobacterium pectinovorum describes “Catalyzes the anaerobic formation of alpha-ketobutyrate and ammonia from threonine in a two-step reaction.” This supports potential amino-acid nitrogen utilization, but not growth on threonine as the sole nitrogen source. Our refinement process is designed to retain the former inference while rejecting the latter unsupported conclusion, relying on Qwen3.5-27B's ability to assess evidential support rather than deterministic biological rules.
Subsequent deterministic checks only validate output structure, evidence references, and predefined failure patterns. Importantly,
support_levelis model-generated, not independently verified. We additionally conducted a GPT-based review of 136 trajectories (8 strains per task across 17 tasks), all of which passed. Nevertheless, these procedures do not guarantee biological correctness. We have clarified the validation process and its limitations in Appendix B.3.