- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes EvLink, a source-grounded evidence-linking framework for improving multi-hop retrieval in GraphRAG. The authors identify that existing GraphRAG methods often rely on semantic similarity or entity associations, which may introduce irrelevant passages and fail to recover complete evidence chains. To address this issue, EvLink constructs two types of cross-passage links: relation-grounded evidence links and endpoint-alignment links. It then employs bounded BFS search to retrieve candidate passages, followed by evidence-need mining and noisy-OR coverage optimization to select complementary and non-redundant evidence. Experiments on five question-answering benchmarks demonstrate that EvLink improves retrieval recall(R@5) , answer accuracy(EM) and F1 scores over existing RAG and GraphRAG baselines.
Critical strengths
1. Well-motivated and effective evidence-linking framework.
The paper addresses an important limitation of existing GraphRAG methods, where graph connectivity does not necessarily imply evidence support. By constructing source-grounded cross-passage links and combining them with evidence-need mining and coverage-based selection, EvLink provides a practical approach to improving multi-hop evidence retrieval.
2. Strong experimental results and comprehensive validation.
EvLink achieves competitive improvements over several recent GraphRAG and evidence-aware retrieval baselines across five QA benchmarks, particularly on 2WikiMultiHopQA. The ablation studies and controlled graph-structure experiments further demonstrate the effectiveness of the proposed components and show that the improvements cannot be explained solely by increased graph connectivity.
Critical weaknesses
1.Limited methodological novelty and insufficient comparisons with closely related work.
The proposed framework primarily combines existing techniques, including OpenIE-based relation extraction, graph traversal, question decomposition, and greedy coverage optimization. Although source-grounded evidence linking provides a meaningful distinction, the paper lacks direct comparisons with several recent approaches addressing similar challenges, such as LinearRAG, NeuroPath. This makes it difficult to establish the novelty and advantages of the proposed method over the latest GraphRAG techniques. Furthermore, a newly emerged method called SAG offers an approach that has also influenced the future sustainability of the research presented in this paper.
2.Insufficient validation of evidence-link reliability.
The paper claims that source-grounded links provide more reliable evidence connections, but the construction process mainly relies on extracted relations and entity matching, which do not necessarily guarantee valid evidential support. Although the ablation and structural control experiments demonstrate retrieval improvements, the paper lacks direct evaluations of link correctness and evidence-support quality. This weakens the justification for its central claim that the proposed links capture meaningful evidential relationships rather than merely improving graph connectivity.
Questions for authors
The authors propose a "Source-Grounded Evidence Links" method, the effectiveness of which is supported by extensive experiments and ablation studies. However, I believe the following aspects could be improved, or the authors should provide a rebuttal:
1. The contribution of the graph construction method is not sufficiently isolated
In the comparisons between EvLink and methods like HippoRAG 2, PropRAG, and NeocorRAG, not only do the graph construction approaches differ, but the subsequent retrieval, question decomposition, and re-ranking algorithms also vary. Consequently, even though EvLink achieves higher R@5, EM, and F1 scores, it remains unclear whether these improvements stem primarily from the "Source-Grounded Evidence Links" themselves or from the subsequent "Evidence-Need Mining" and "Noisy-OR" optimization. While Table 3 in the paper compares the method against Dense KNN, Same-seed KNN, and random graphs, these baselines do not constitute a direct comparison with state-of-the-art GraphRAG graph construction mechanisms. Therefore, while the current experiments demonstrate that the proposed graph structure outperforms certain simple graph structures, they do not sufficiently prove its superiority over advanced GraphRAG graph construction mechanisms.
2. There is a lack of direct evaluation regarding the correctness of the evidence links.
Although EvLink claims to construct "Source-Grounded Evidence Links," the actual mechanism relies primarily on: (OpenIE Fact+ Endpoint Matching)
For example: (Titanic, directed by, James Cameron)
Here, a cross-document link is established by matching the entity "James Cameron" to a target document. A potential issue arises here: the existence of a relational fact derived from a source does not guarantee that the resulting link actually supports the reasoning required for a given query. I suggest that the authors randomly sample a subset of the generated links and conduct human annotation to evaluate at least the following three metrics:
- Relation Correctness: Whether the extracted relation is accurate.
- Endpoint Alignment Accuracy: Whether the link correctly connects to the intended target document.
- Evidence Support Validity: Whether the link genuinely provides meaningful cross-document evidence to support reasoning.
In particular, the correctness of "Relation-Grounded" links and "Endpoint-Alignment" links should be reported separately. This would provide direct evidence for the paper’s core claims, rather than merely demonstrating an improvement in final retrieval performance.
3.Experiments on complex multi-hop problems are not yet sufficient.
EvLink performs notably well on 2WikiMultiHopQA, but its improvement on MuSiQue is relatively limited. Furthermore, as shown in Appendix A.2 of the paper, the "evidence-need mining" component achieves an evidence recall rate of only 65% for four-hop questions. It is recommended to provide a breakdown of results based on the number of reasoning hops—reporting metrics such as R@5, All@5, EM, and F1 separately for two-hop, three-hop, and four-hop questions. Additionally, the impact of the maximum number of hops in the BFS (breadth-first search) and the size of the candidate pool on the overall performance should be analyzed.
This would help determine whether EvLink is truly capable of handling complex multi-hop reasoning, rather than merely being effective at retrieving relatively simple chains of entity relations.
4.The research conclusions are stated too strongly
On page 6, the paper claims that EvLink outperforms all baseline methods across all benchmarks; however, Table 1 shows that on the MuSiQue dataset, the EM score for ETS-7B is 40.0%, while for EvLink it is 37.2%. Since ETS-7B and EvLink utilize different models for generating the final answer and the authors themselves have noted that a direct comparison is not appropriate.
If the author addresses these questions, I will consider raising the score.