- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors propose to train, using an RL framework, a policy that refines a knowledge base in a query dependent manner. In order to do so they construct, using query answer pairs, a reward based on the tokenwise F1 of the ground truth when using the refined knowledge base to answer the query via RAG. In order to produce the candidate refinements they design a judgement-abduction-refinement harness/scaffolding/prompt.
Critical strengths
The combination of (1) agentic KB refinement (i.e. with an existing KB) and (2) RL using query answer pairs is, to the best of my knowledge novel. It is also timely since despite the extensive work in agentic KB generation, (imperfect) KBs are readily available in many settings. Both challenges that the paper puts forward in the introduction (lack of GT refinement trajectories via RL, and the guided exploration of the KG via their heuristic design) are well motivated and addressed by their method.
Critical weaknesses
I find that both agentic KG refinement (e.g.[1, 2] ) and RL methods for KG refinement/editing (e.g. [3]) are missing in the related work discussion. This is not a novelty weakness since I do not know of any work that has all of the components of the method proposed in the current manuscript and its same settings. However, I believe that these (and other) existing works should be better contrasted in the manuscript with the proposed approach to better underline its novelty and scope. In the same vein, I believe that including a learned KB adaptation method in the main experimental results would strengthen the experimental claims.
[1] LLMs as Knowledge Graph Refiners: Mitigating Factual Inconsistencies in Generative Knowledge Extraction. Kim et al., ACL 2026
[2] TRAIL: Joint Inference and Refinement of Knowledge Graphs with Large Language Models. Zhao et. al arXiv preprint 2025.
[3] KGER: Knowledge Graph Error Detection and Refinement with Reinforcement Learning A. Maoliniyazi ICASSP 2026
Questions for authors
None
2 comments
Dear Reviewer ycWh,
As the discussion deadline is approaching, we wanted to kindly ask whether our response has addressed your concerns. We are happy to provide any further clarification before the discussion closes.
Thank you again for your time.
Response to Reviewer ycWh (1/1)
Thank you for recognizing the value and novelty of our agentic KB refinement method with RL. Also thanks for your recognition about our supported claim!
We appreciate the references and have contrasted these methods more clearly in the revised version.
GraphRefine [1] fine-tunes an LLM to correct triple-level inconsistencies between a generated KG and its source text. DeepRefine instead uses queries to locate and edit potentially problematic KB regions, and learns its refinement policy from downstream QA feedback without requiring gold edit trajectories.
TRAIL [2] uses confidence-based validation to incorporate and refine facts generated during reasoning. DeepRefine instead learns to repair an existing KB using downstream feedback, without gold edit trajectories. The distinction is therefore fact-confidence-driven knowledge integration versus task-utility-driven KB refinement.
KGER [3] uses RL for error detection and correction over graph-specific entity and relation embeddings. Its released implementation accepts a triple or replaces its head, relation, or tail using a predefined entity/relation vocabulary. DeepRefine instead targets query-conditioned refinement of open-text structured KBs using downstream QA feedback. Applying KGER to this setting would require adapting its representation and correction pipeline.
We did not find official public implementations for GraphRefine or TRAIL. And KGER’s implementation is public, but its method can not be generalized to our open-text structured KBs. Our current results therefore do not constitute a direct comparison with these methods. We have discussed them in the related work of our revision.
[1] LLMs as Knowledge Graph Refiners: Mitigating Factual Inconsistencies in Generative Knowledge Extraction. Kim et al., ACL 2026
[2] TRAIL: Joint Inference and Refinement of Knowledge Graphs with Large Language Models. Zhao et. al arXiv preprint 2025.
[3] KGER: Knowledge Graph Error Detection and Refinement with Reinforcement Learning A. Maoliniyazi ICASSP 2026