- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Cella, a multiscale metabolic heterogeneous graph model for predicting microbial cultivation requirements and environmental preferences. It places taxon, organism, metabolite, media component, and medium nodes in one graph, and uses relation-typed message passing to learn representations across genomes, metabolic models, chemical structures, phylogeny, and cultivation conditions. The main contributions are a dataset covering thousands of prokaryotic genera with GEMs reconstructed by three pipelines, a unified compound and reaction namespace, and a heterogeneous graph that handles missing modalities. Experiments compare against popularity, lineage-only, and genome-only baselines under organism-grouped and component held-out splits, evaluating media, component, carbon-source utilization, environmental preference, component substitution, and strain ranking tasks. Results show that Cella achieves the best macro F1 on media and component prediction, and can propose media for many genera without known cultivation records.
Critical strengths
-
Large-scale, multimodal, cross-scale heterogeneous graph resource. The paper integrates genomes, GEMs from three metabolic reconstruction pipelines, media, components, metabolites, and taxa, and unifies compound and reaction namespaces across many prokaryotic genera. The resource has independent value as a benchmark for microbial phenotype prediction and naturally handles missing modalities, rather than only serving the proposed model.
-
Rigorous leakage-aware evaluation protocol. The paper uses organism-grouped, component held-out, and out-of-family splits, rebuilds the graph within each split to remove growth relations of test organisms, and adopts degree-matched negatives with popularity and lineage baselines. Cultivation prediction is easily inflated by homology leakage and popular-component bias, and this protocol makes the reported results credible even when gains are modest.
Critical weaknesses
-
The core performance comparison uses inconsistent evaluation protocols, making the main conclusion unreliable. The footnote in Appendix Table S5 states that Cella was scored on its own protocol and is not directly comparable with the feature baselines above it, yet the main text still places Cella alongside those baselines and uses the table to claim best or comparable performance. If the footnote is correct, all horizontal performance claims lose their basis. If the footnote is wrong, the appendix is misleading. The central empirical claim therefore depends on resolving this inconsistency.
-
The contribution of the heterogeneous graph structure is not established, and simple baselines are often as good or better. The paper's main selling point is a multiscale metabolic heterogeneous graph, but it lacks key ablations, especially removing the entire GEM layer, metabolite nodes, and their relations while keeping only taxon, organism, component, and medium. Existing results show that simple genome-feature or feature-concatenation baselines are already competitive on multiple tasks, and the authors acknowledge that the genome block supplies most of the learnable signal. The independent gain from graph message passing and the metabolic layer is therefore not established.
Questions for authors
-
What exactly does the Table S5 footnote mean by "its own protocol"? How do Cella and the feature baselines differ in label sets, candidate space, or threshold fitting? If such differences exist, how should the horizontal comparison in Table 2 be interpreted?
-
Have you run an ablation that removes the entire GEM layer, i.e., dropping metabolite nodes and requires/asserts relations while keeping only taxon, organism, component, and medium? If not, how do you establish that the multiscale metabolic heterogeneous graph itself, rather than additional input features, provides the performance gain?
-
Are the medium proposals for genera without cultivation records independently validated, for example through temporal holdouts, external data, or wet-lab experiments? If not, can you at least report sample sizes, performance metrics, and confidence intervals by phylogenetic distance bin to support the extrapolation claim?