- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates the retrieval contamination problem in RAG-based auto-research systems. When manipulated evidence is retrieved in the initial Top-K results while the corrective sources are ranked lower in the same corpus, existing RAG systems usually return the wrong results. To address this, the paper proposes a new mechanism, AF-RAG, to identify verifiable claims and generate targeted falsification queries. Based on these, it actively retrieves additional evidence to correct contaminated answers. The experiments show that the proposed AF-RAG improves truth recovery and reduces adoption of poisoned claims under a controlled setting.
Critical strengths
-
The problem setting is clear and the proposed method is intuitive. The paper focuses on a concrete failure mode in which the initial Top-k retrieval results contain manipulated claims while corrective evidence remains retrievable at deeper ranks in the corpus. Under this setting, actively searching for counter-evidence to verify potentially unreliable claims is a simple and natural idea.
-
The experiments and analysis are quite comprehensive within the proposed setting. The paper includes component ablations, experiments under different evidence-placement conditions, cross-domain evaluations on Physics and PMC, multi-model experiments, and retrieval-budget-matched comparisons.
Critical weaknesses
-
The robustness results depend on a controlled placement of poisoned evidence. The benchmark preserves entities, metrics, and experimental conditions that AF-RAG uses to retrieve the authentic source, while placing poisoned evidence in the initial context and corrective sources outside it. This matches the stated threat model, but largely limits generalization. With clean initial evidence and a poisoned deep pool, truth accuracy is 97% for Naive RAG but 17% for AF-RAG (Tab 23). The supplementary module partly addresses this, raising JSR from 18% to 53% in the correct/poisoned condition, but uses fixed first-round evidence and a clean follow-up index, and lowers JSR from 49.5% to 42% in the poisoned/correct condition (Tab 2). What if the location of poisoned evidence is unknown?
-
The contribution of the falsification mechanism is unclear. Claim auditing, evidence retrieval, and correction closely resemble existing verification approaches such as FIRE [1] and RARR [2], but they are not compared under the same corpus and retrieval constraints. The existing retrieval-budget and claim-based controls are useful, but do not fully separate query construction, exclusion of initial documents, and evidence-prioritized synthesis. A simple baseline could exclude the initial document IDs, retrieve with the original query or generic rewrites under matched budgets, and answer only from the new evidence. Comparing full AF-RAG with an answer generated from the same external evidence alone would help clarify whether its gains require conflict adjudication.
-
[1] FIRE: Fact-checking with Iterative Retrieval and Verification (Xie et al., NAACL 2025)
-
[2] RARR: Researching and Revising What Language Models Say, Using Language Models (Gao et al., ACL 2023)
Questions for authors
-
How would AF-RAG decide when to trust external evidence if the location of poisoned evidence is unknown?
-
Could you compare adapted versions of FIRE and RARR under the same corpus and retrieval constraints?
-
Could you compare AF-RAG with a baseline that excludes the initial document IDs, retrieves using the original query or generic rewrites under matched budgets, and answers only from the new evidence? Also, how does full AF-RAG compare with answering from exactly the same external evidence alone?