- Rating
- 3(+1)
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies hallucination in LLM generation, focusing on when external retrieval should be triggered to prevent errors from propagating. The authors propose Grounded-R1, a dynamic RAG framework that combines Real-time Hallucination Risk Detection (RHRD) with two-phase reinforcement learning. RHRD estimates sentence-level hallucination risk using generation-time signals. The first training phase optimizes answer quality and retrieval cost, while the second uses sentence-level risk-based rewards to improve retrieval timing. Experiments on eight knowledge-intensive benchmarks compare Grounded-R1 with existing RAG methods in terms of answer quality, hallucination rate, and retrieval efficiency.
Critical strengths
(i) The paper focuses on hallucinations in knowledge-intensive LLM generation, where unsupported claims can affect subsequent reasoning and lead to incorrect final answers.
(ii) The experimental evaluation is extensive, covering eight knowledge-intensive benchmarks and comparisons with various RAG methods. The paper also includes ablation studies, retrieval-cost analysis, sentence-level hallucination evaluation, and controlled experiments examining the effect of retrieval timing.
Critical weaknesses
(i) The paper does not establish whether hallucination risk is a suitable signal for deciding when retrieval is beneficial. Eq. (6) rewards retrieval when the RHRD score is high, while Appendix B.9 states that the sentence-level reward does not estimate the counterfactual downstream utility of retrieval. The paper evaluates RHRD against hallucination labels and uses intervention experiments to show that earlier retrieval can improve subsequent generation. However, these experiments do not examine whether positions with higher hallucination risk are also those where retrieval provides greater benefits.
(ii) The paper does not establish why its sentence-end retrieval decisions can better address premature or delayed retrieval than existing methods. Approaches such as FLARE and IRCoT already use sentence-level generation or reasoning steps to guide retrieval. Section 3.2 explains the choice of sentence-end decisions as a trade-off between timeliness and semantic completeness, but does not show why this choice leads to better retrieval timing. Table 4 demonstrates that inserting the same evidence one sentence earlier improves subsequent generation, rather than showing that the proposed decision mechanism is better at choosing when to retrieve. Although Table 5 compares retrieval-position selection under equal budgets, the direct differences between Grounded-R1 and the compared policies are not statistically conclusive in Appendix J.7. Therefore, the claimed advantage in avoiding premature or delayed retrieval over existing approaches remains uncertain.
Questions for authors
(i) Please provide further analysis of the relationship between RHRD scores and the actual downstream benefits of retrieval.
(ii) Please provide further evidence that sentence-end decisions help avoid premature or delayed retrieval compared with existing approaches.