- Rating
- 1(−1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes GEM-Reasoner, a framework for genome-scale metabolic model reconstruction that combines retrieval-augmented generation (RAG) with LLM-based protein function reasoning. The method retrieves multidimensional functional evidence and uses conflict detection to guide iterative retrieval. An LLM then assesses functional equivalence between proteins to support metabolic network reconstruction.
Critical strengths
The paper addresses the limitations of similarity-based methods in identifying protein functional relationships under remote homology, functional divergence, and differences in substrate specificity. By combining RAG with LLM-based reasoning, the proposed framework introduces a conflict-aware retrieval mechanism to improve protein function annotation for genome-scale metabolic model reconstruction.
The framework is clearly presented, and the experiments cover both protein functional similarity prediction and downstream metabolic model evaluation. The results show substantial improvements over existing methods, particularly on challenging protein pairs.
Critical weaknesses
The main weakness of this paper is its limited methodological novelty. The proposed framework mainly combines established techniques, including protein function retrieval, conflict detection, iterative retrieval-augmented generation, and LLM-based reasoning. Although CAPA-RAG introduces conflict-guided retrieval, its technical contribution beyond existing retrieval and reasoning frameworks remains limited. Moreover, the GEM reconstruction stage directly follows the CarveMe pipeline, replacing sequence similarity scores with functional similarity scores.
Another concern is whether the performance improvements can be attributed to the proposed conflict-aware retrieval mechanism. Although the ablation experiments demonstrate the effectiveness of CAPA-RAG, the paper does not compare it with alternative retrieval strategies under comparable evidence and computational budgets. Therefore, it remains unclear whether the improvements mainly come from conflict-aware retrieval or from the additional functional evidence and LLM processing.
Finally, the proposed framework may suffer from high computational costs. GEM-Reasoner involves multiple LLM agents, iterative retrieval, and pairwise functional reasoning, which could introduce substantial inference overhead, particularly for genome-scale reconstruction. The computational efficiency and practical scalability of the framework require further investigation.
Questions for authors
-
What are the main technical innovations of CAPA-RAG beyond existing retrieval and LLM-based reasoning frameworks?
-
How can the authors distinguish the contribution of conflict-aware retrieval from the benefits of additional functional evidence and LLM processing?
-
What are the computational costs and practical scalability of GEM-Reasoner compared with existing GEM reconstruction methods?