- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes LatentRAG, a framework that integrates continuous latent reasoning with knowledge graph question answering (KGQA). Instead of generating discrete textual relation paths, the method autoregressively produces latent hidden states and projects them into scores over the KG's relation vocabulary. These scores are used to construct weighted graph transitions and perform multi-hop entity propagation. The model subsequently reconstructs explicit reasoning paths, which are provided to a separate reader LLM for final answer generation.
Critical strengths
- An interesting approach to bridging latent reasoning and structured knowledge.
The paper addresses the mismatch between textual relations generated by LLMs and the actual relation vocabulary of a knowledge graph. Mapping latent states directly to KG relation scores is a reasonable way to avoid exact textual relation matching. Moreover, restricting entity propagation to existing KG edges provides explicit structural grounding.
- Promising empirical results.
The method achieves strong Hits@1 results on WebQSP and CWQ. The ablation studies also provide evidence that latent reasoning contributes to performance. The framework offers an interesting direction for connecting continuous neural reasoning with explicit graph-based retrieval.
Critical weaknesses
1. Insufficient methodological clarity and justification.
The latent reasoning process does not explicitly incorporate intermediate KG states, raising questions about whether it performs genuinely graph-conditioned reasoning. Moreover, the paper lacks important implementation details, including how multiple relations between the same entity pair are handled, how the reasoning depth is determined, and how per-hop relation supervision is constructed over a large relation vocabulary.
2. Insufficient experimental validation of the core contribution.
The comparisons mainly involve older baselines, with limited coverage of recent KGQA methods. More importantly, the improvement from latent reasoning is relatively small on CWQ (+0.7 Hits@1), while the final reader contributes substantially to overall performance. The reader LLM is not clearly specified, making it difficult to isolate the benefits of the proposed latent reasoning mechanism and assess the fairness of the comparisons.
Questions for authors
Q1. Relation mapping and scalability.
Eq. (5) predicts scores over the entire KG relation vocabulary at every reasoning step, although each question may involve only a small subset of relations. How is the global relation vocabulary constructed, particularly when using question-specific KG subgraphs such as those provided by RoG? Why is it necessary to score all relations rather than only the currently reachable ones? How does this design scale to larger or dynamically changing relation vocabularies?
Q2. Relation supervision and training loss.
How are the per-hop multi-hot relation labels in Eq. (10) constructed? Given the large number of relations and relatively few positive labels per question, how is class imbalance handled? Moreover, when multiple valid reasoning paths exist, how does the method avoid incorrectly treating unannotated but valid relations as negative examples?
Q3. Graph transition matrix construction.
How is the transition matrix in Eq. (6) implemented for large-scale KGs? Is it constructed dynamically for each question-specific subgraph or over the entire KG? Additionally, when multiple relations connect the same pair of entities, how are their relation scores aggregated into a single matrix entry?
Q4. Reader LLM and contribution of latent reasoning.
Which specific LLM is used as the final reader in Section 3.4, and is it fine-tuned? Since the reader substantially improves performance, while the gain from latent reasoning on CWQ is relatively small, how can the authors demonstrate that the improvements primarily originate from the proposed latent reasoning mechanism rather than the reader's own knowledge or reasoning capability?
Q5. Comparison with recent methods.
Why does Table 1 mainly compare against methods published before 2025? Can the authors include more recent KGQA baselines under comparable backbone, KG, and reader settings to provide stronger evidence of the proposed method's effectiveness?