- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces TaxoMFM, a foundation model for human gut microbiome profiling that leverages microbial taxonomic hierarchies through self-supervised learning. Unlike conventional approaches that represent microbial species independently, TaxoMFM integrates multiple taxonomic levels and incorporates attention biases based on taxonomic relationships. The model also introduces a hierarchical compositional decoder to reconstruct microbial abundances across taxonomic levels. During pretraining, it combines multiscale composition reconstruction with hierarchical composition learning to capture both microbial abundances and relative compositions within higher taxonomic groups. The authors construct TaxoGut-HPP, a comprehensive microbiome dataset collected from diverse cohorts, and evaluate the model on various classification and regression tasks. TaxoMFM demonstrates strong predictive performance compared with existing methods, while ablation studies highlight the contributions of taxonomic structure and hierarchical learning objectives.
Critical strengths
-
TaxoMFM effectively integrates taxonomic hierarchy into both its attention mechanism and hierarchical compositional decoder, rather than treating taxonomy as an additional input feature. Learning microbial abundances and relative compositions within taxonomic groups is well suited to the characteristics of microbiome data.
-
The paper evaluates TaxoMFM across diverse prediction tasks, including disease classification, gut health symptoms, host characteristics, and liver health indicators. The results demonstrate consistent improvements over existing methods across various tasks.
Critical weaknesses
-
TaxoMFM is pretrained on 100,806 profiles, substantially more than BiomeGPT (13,524) or GUT-FORMer (21,024). While the ablations support the proposed design, they do not rule out the possibility that part of the improvement over existing models comes from the larger pretraining corpus. Comparisons under matched data and training budgets would strengthen the architectural claims.
-
The cross-cohort evaluation is limited to three target cohorts, including only 130 samples for IBD. The improvement on IBD is also relatively modest (0.722 vs. 0.693 AUROC). Without uncertainty estimates or additional cohort combinations, it is difficult to judge how reliably these gains generalize.
-
The main novelty seems to lie in combining existing ideas rather than introducing a substantially new modeling approach. While the empirical results are strong, the methodological contribution beyond prior taxonomy-aware models is not entirely clear.
Questions for authors
-
Could the authors compare TaxoMFM with existing foundation models pretrained on the same data, to better isolate the contribution of the proposed architecture?
-
For the IBD cross-cohort result (0.722 vs 0.693, n=130), is the improvement statistically meaningful? Could the authors report bootstrap confidence intervals for Table 5?
-
In Table 8, TaxoMFM retains 81.44% of the abundance while BiomeGPT retains only 45.79%. How much of the improved vocabulary robustness is attributable to ancestor routing rather than the learned representations?
5 comments
Response to Reviewer (Part 2/3)
- Q1: Could the authors compare TaxoMFM with existing foundation models pretrained on the same data, to better isolate the contribution of the proposed architecture?
Thank you for this suggestion. This is the setting of our comparison. TaxoMFM and all other foundation models are pretrained from scratch on the same set of TaxoGut-HPP samples, as described in our reply to W1. We will state this explicitly in Section 4.1. We chose TaxoGut-HPP because it provides large-scale pretraining data and covers 40 classification and 8 regression tasks across disease, gut health and continuous physiological traits.
Under this shared setting, TaxoMFM outperforms the foundation models without explicit taxonomic hierarchy on the classification and regression tasks in Tables 2 and 3. For example, on IBD classification in Table 2, TaxoMFM reaches an AUROC of 0.985, against 0.966 for the best baseline, GUT-FORMer. On the liver attenuation coefficient in Table 3, TaxoMFM reaches a Spearman of 0.347, against 0.329 for BiomeGPT.
Table 4 further tests the contribution of the taxonomic hierarchy through architectural ablation. With the same pretraining data, removing the genus, family and order nodes lowers the mean AUROC on colorectal cancer, IBD and type 2 diabetes from 0.957 to 0.922. This supports the contribution of explicit hierarchy modeling to downstream prediction.
- Q2: For the IBD cross-cohort result (0.722 vs 0.693, n=130), is the improvement statistically meaningful? Could the authors report bootstrap confidence intervals for Table 5?
Thank you for this question. As you note in W2, the IBD target cohort has only 130 samples, so a test on this cohort alone has limited power. We therefore add two IBD target cohorts, Cork (n = 87) and UCSD (n = 197), and test the gain on the three cohorts together. This gives 414 target samples. We compare TaxoMFM with the strongest baseline in each cohort. We perform paired resampling within each cohort and average the gain over the three cohorts, with 10,000 bootstrap resamples. Across the three cohorts, TaxoMFM achieves a mean AUROC of 0.765 (95% CI 0.719 to 0.811), with a mean gain of 0.041 over the strongest baseline in each cohort (two-sided ).
We run the same paired bootstrap on the other two target cohorts in Table 5. For colorectal cancer (n = 194), the gain over BiomeGPT is 0.075 (two-sided ). For type 2 diabetes (n = 783), the gain over the Species-only variant is 0.039 (two-sided ).
The table below reports bootstrap 95% confidence intervals for Table 5. We will add these results to the revised Table 5.
| Model | CRC (n = 194) | T2D (n = 783) | IBD (n = 130) |
|---|---|---|---|
| Random Forest | 0.619 [0.537–0.698] | 0.634 [0.573–0.694] | 0.631 [0.531–0.737] |
| MIOSTONE | 0.643 [0.561–0.720] | 0.562 [0.513–0.615] | 0.693 [0.601–0.774] |
| PhyloGCNE | 0.610 [0.531–0.693] | 0.602 [0.548–0.658] | 0.567 [0.468–0.665] |
| MGM | 0.744 [0.672–0.813] | 0.670 [0.618–0.719] | 0.664 [0.565–0.763] |
| BiomeGPT | 0.763 [0.686–0.831] | 0.683 [0.629–0.731] | 0.679 [0.594–0.758] |
| Species-only | 0.759 [0.691–0.821] | 0.697 [0.651–0.739] | 0.688 [0.601–0.766] |
| TaxoMFM | 0.838 [0.778–0.893] | 0.736 [0.697–0.775] | 0.722 [0.638–0.796] |
Response to Reviewer (Part 3/3)
- Q3: In Table 8, TaxoMFM retains 81.44% of the abundance while BiomeGPT retains only 45.79%. How much of the improved vocabulary robustness is attributable to ancestor routing rather than the learned representations?
Thank you for this question. The cross-vocabulary robustness in Table 8 has two parts: how much abundance is retained, and whether the same sample can be matched. The retention gap you mention (81.44% vs. 45.79%) comes entirely from ancestor routing. Routing decides which abundance is retained before the encoder reads the data, so it is independent of the learned representation. Sample matching depends on both. To separate them, we add two controls that need no pretraining.
Ancestor routing works as follows. The same sample is expressed in the current and the legacy vocabulary. If a species has no match in the legacy vocabulary, its abundance is assigned to its genus. If the genus has no match, it goes to the family, and then to the order. This is the nearest rank that both vocabularies recognize. Without routing, this abundance is discarded.
We compare three matching methods: (1) direct comparison of abundances at the species, genus, family and order ranks, without an encoder; (2) a randomly initialized, untrained TaxoMFM encoder; (3) the pretrained TaxoMFM encoder, as in Table 8. For each method, we compute bidirectional R@1 (Appendix C.4) with routing off and on.
| Matching method | Routing off | Routing on | Gain from routing |
|---|---|---|---|
| Direct abundance comparison | 17.99% | 59.44% | +41.45 |
| Randomly initialized TaxoMFM encoder | 5.63% | 25.32% | +19.69 |
| Pretrained TaxoMFM encoder | 67.69% | 86.64% | +18.95 |
Reading across a row shows the effect of routing. Reading down a column shows the effect of the representation. Routing raises R@1 for all three methods, so the retained abundance itself helps identify the same sample. With routing on, the pretrained encoder reaches 86.64%. This is 27.20 points above direct abundance comparison and 61.32 points above the randomly initialized encoder. The random encoder has the same architecture as the pretrained one, yet it scores below direct comparison. The gain therefore comes from the representation learned in pretraining, not from the architecture. We will add these controls to Appendix.
Response to Reviewer (Part 1/3)
Thank you for this comment. All foundation models in Tables 2, 3 and A3–A8 are pretrained from scratch on the same TaxoGut-HPP samples as TaxoMFM. The pretraining data size is therefore the same for every model in these comparisons. Each foundation model keeps the architecture and pretraining objective of its original paper. BiomeGPT has no public code, so we implemented it from the description in its paper. On each downstream task, all models use the same participant splits and metrics. The numbers 13,524 and 21,024 are the pretraining sizes reported in the original BiomeGPT and GUT-FORMer papers. Table 1 lists the data scale of each model's original paper. We will note this in the caption of Table 1 and state the pretraining data of all foundation models in Section 4.1.
We agree that the pretraining budget matters when comparing models. On a single RTX PRO 6000 GPU and the same dataset, we estimate the pretraining time at 36.6, 33.8, 38.1 and 53.8 GPU-hours for TaxoMFM, BiomeGPT, MGM and Waypoint-45M. With a budget close to BiomeGPT and MGM, TaxoMFM ranks first on 46 of the 48 downstream tasks and achieves the highest AUROC on all three zero-shot cross-cohort tasks (Table 5). It also leads in multiscale perturbation recovery, rare-species abundance recovery and cross-vocabulary sample matching (Tables 6–8). We will list the pretraining time of each model in Appendix D.
Thank you for this suggestion. We add two independent IBD target cohorts: Cork (n = 87) and UCSD (n = 197). As in Table 5, the samples of these cohorts are excluded from both pretraining and downstream training. We keep the source-cohort training setup of the original experiment. Values are AUROC (95% CI).
TaxoMFM achieves the highest AUROC on both new cohorts. On Cork, its AUROC is 0.846 (0.762–0.923), 0.054 above the strongest baseline. On UCSD, its AUROC is 0.727 (0.629–0.815), 0.039 above the strongest baseline. Together with the gain of 0.029 on the original IBD target cohort, TaxoMFM outperforms the best baseline on all three independent IBD cohorts.
Thank you for raising this point. TaxoMFM differs from prior taxonomy-aware models in where the taxonomy is used. Models such as MIOSTONE use the taxonomy inside a supervised predictor. They connect taxa across ranks, aggregate features rank by rank, and are trained separately for each phenotype. TaxoMFM uses the taxonomy to define the self-supervised pretraining objective. A single pretrained representation then serves all downstream tasks. This representation separates changes in the total abundance of a lineage from changes in its internal composition. This separation matters for studies of disease and host phenotypes. For example, when the relative abundance of a species increases, the whole lineage may have expanded. Alternatively, the lineage total may be stable while the species takes a larger share within it.
During pretraining, we mask the abundances of some species or of whole taxonomic branches, and reconstruct the community from a single sample representation. The multiscale reconstruction loss (Eq. 8) requires the model to recover the abundance distribution at the species, genus, family and order ranks. This preserves the share of each lineage in the whole community. The hierarchical composition loss (Eq. 9) directly supervises how abundance is divided within each parent. The model therefore captures shifts among members even when the lineage total is stable. The controlled perturbation experiment in Table 6 shows that TaxoMFM recovers both types of change more accurately from partial observations.