- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes MultiRAG-Bench, a benchmark comparing graph fusion and joint retrieval over multiple domain KGs. Five KGs are extracted from the same MuSiQue corpus with different prompts, and 2,348 Neo4j-verified cross-graph questions are generated. Joint retrieval achieves the highest path hit rate.
Critical strengths
S1: The paper studies a practical question of whether multiple KGs should be merged or queried jointly. S2: Every gold chain is verified by Neo4j, and the union control and leakage analysis are reported honestly.
Critical weaknesses
W1: The cross-domain requirement is artificial. All graphs come from the same corpus and differ only in prompts, and the questions are selected to need edges from different graphs, so the finding that merging helps here but not on MuSiQue follows by construction. W2: The comparison is unfair. Joint pools about 39 entities from five graphs vs. about 8 for a single graph, and when the pooled result is cut to 25 entities, PHR drops from 54.64 to 23.08. No end-to-end QA is reported.
Questions for authors
Refer to Weakness.