- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work aims to improve LLM-based KGQA performance in two ways: (1) when the essential triple for reasoning is structurally missing from the KG; (2) when the triples are computationally buried in dense neighbourhoods. To address this issue, it first parses a question into triples with specific and generic entities. The LLM may propose candidate "probes" (i.e., instantiations) for triples with exactly one specific end. In dense neighbourhoods, probes are intersected with all neighbours to get a relation context. When local exploration fails, probes may create existence-grounded or virtual bridges, which are kept only if later reasoning stays consistent.
Critical strengths
The example in Figure 3 is clear and easy to follow.
Critical weaknesses
-
The answer-generation prompt (Table 13) instructs the model to "answer with your own knowledge" when the triples are insufficient, and Section 4.1 describes an LLM-only fallback when no anchor is found, which contradicts the claim of not "relinquishing factual control to the LLM". -- this is a soundness issue.
-
The claim of recovering from structurally missing KG links is never tested in a controlled setting, since all the experiments use the standard WebQSP/CWQ splits over full Freebase or Wikidata, and the paper itself states that its case study "does not establish missing-edge repair" -- so the claim is not substantiated.
-
Regarding the first contribution, the term "interface" is not clearly defined, making it difficult to understand what the proposed contribution actually entails. Overall, the technical novelty appears limited, and the work seems to be largely an incremental engineering effort rather than a substantive research contribution.
Questions for authors
In Table 1, why are the results for CWQ-partial and CWQ-complete all the same?