- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes, FactCheckRL, a RL-trained agentic fact checker, which is equipped with a search tool to check for factual errors in a given response. It is trained to reason and issue search queries adaptively, and is shown to significantly outperform existing fact check methods such as SAFE, VeriScore, and FaStFact. FactCheckRL is further used as a factuality reward in post-training Nemotron using an improved variant of Chen et al., (2025), which significantly improves the model's factuality while not regressing on helpfulness.
Critical strengths
-
The paper proposes a sensible approach to a practical and important problem, which achieves strong empirical performance. Training an agentic model to issue search queries itself for fact checking allows the model more flexibility than previous works which follows the fixed decompose-search-verify pipeline. FactCheckRL's fact-checking performance beats other baselines in both in-distribution (their own held-out test set) and out-of-distribution evaluations (test set from FaStFact).
-
When used as a factuality reward during post-training, FactCheckRL is highly effective. It identifies an important flaw in the previous work (Chen et al., 2025) which used linear combination of helpfulness and factuality rewards. The argument that geometric or harmonic combinations make more sense as it penalizes the model for low score on either front is sound and proven by empirical results.
-
The fact-checking data, which the authors promise to release, would be valuable to the research community.
Critical weaknesses
-
Only one factuality benchmark (LongFact) and one helpfulness guardrail (ArenaHard) are reported. LongFact is close to saturation where the contradiction rate is only 3-6% for non-trained open models (and even lower for frontier models). It would strengthen the results if results are reported on more long-form factuality benchmarks. For example, the previous work cited by this paper (Chen et al., 2025) reported several other datasets alongside LongFact.
-
The paper considers two search corpora, both using offline closed sets of documents (20M and 200M docs, respectively). To show the versatility and real-world utility of the approach, it would be great to also consider the open web as the search corpus using free or commercial search engines. The latter is more realistic and challenging: There are many facts not present in offline corpora such as Wikipedia, so the ability to search the Internet allows the fact checker to verify a much wider range of claims. On the other hand, the Internet is much more noisy, so retrieving a evidence doc does not mean that the source is trustworthy. The model needs to reason about the retrieved evidence, potentially resolving conflicts, before returning the final verdict. This is in fact somewhere the proposed RL approach may shine even more, so giving the model a proper web search tool could strength this work meaningfully.
Questions for authors
Q1: Is the response-level 5-way numerical score the final score used in training / eval? Are the individual errors only used by the model itself to derive the 5-way score, and discarded afterwards?