- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how provenance cues affect LLMs when external claims conflict with their parametric knowledge. It introduces PROVMARGIN, a Wikidata-based benchmark that fixes candidates and closed-book margins before comparing the same false claim with low-credibility provenance shown or removed. On four core models, removing low-credibility cues increases false adoption by 9.95pp, with a larger effect near the decision boundary, but this localization does not hold consistently across four extension models. The paper also evaluates 30 real-world records and proposes PROVROUTE, which lowers residual false-adoption risk to 27.56% at a 1/6 verification budget.
Critical strengths
The experimental protocol is careful: candidates, margins, and data splits are fixed before any outcome is observed, and confirmatory tests follow a prespecified sequence on a locked test set. The overall effect holds across all eight models and under parser-free label probabilities. The paper transparently reports mixed and negative results, such as the OLMo-2 reversal. It also evaluates both safety (rejecting erroneous claims) and utility (adopting correct updates).
Critical weaknesses
- The controlled study measures the removal of low-credibility cues, not provenance visibility in general. The paper describes the two controlled conditions as follows (§2.1, §3.3):
- Visible: the cues indicate low credibility, limited authority, or out-of-scope expertise.
- Absent: the claim appears “as an imported memory,” with origin, scope, trace, and authority unspecified.
Because the visible condition takes only the low-credibility value, Δprov estimates the effect of removing negative cues, which is how the abstract phrases it. It does not show what happens when provenance is neutral or credible. The title and RQ1, however, frame the question as provenance visibility in general. The authors should either narrow this framing or add neutral and credible-source conditions on the same claims. In addition, since the absent condition is described as an imported memory, it would help to clarify whether it serves as a no-provenance baseline.
-
Missing discussion of and comparison with closely related prior work. PAVE [1] also stratifies conflict behavior by the model’s pre-evidence epistemic state, reports strongly model-dependent arbitration, and proposes a test-time mitigation. ClashEval [2], Adaptive Chameleon or Stubborn Sloth [3], and Context versus Prior Knowledge in Language Models [4] already relate a model’s prior confidence to its adoption of conflicting context. In addition, the task-instruction study in §5 closely resembles Task Matters [5]. The authors should position their contributions against these works, clarify what the provenance manipulation adds beyond prior-state stratification, and include the stability signal of [1] as a baseline for PROVROUTE.
-
Model-level evidence is weak. On the locked test set, only Qwen3-4B has a near–far interval that excludes zero (Table 3). In the extension models, OLMo-2 shows the reverse pattern (Table 4), and the authors themselves conclude that localization is model-specific (§4.2). The statement in Contribution 2 that the near-boundary effect is “consistently larger” therefore holds only at the level of point estimates.
-
The PROVROUTE evaluation does not fully support its claimed advantage. The baselines use less information. PROVROUTE uses the model’s actual response, namely whether it adopted the external claim (Eq. 7), whereas all baselines use only information available before the response (Appendix E.2). The improvement therefore shows that looking at the response helps, but not that PROVROUTE beats simpler response-based rules, such as “verify whenever the model adopts the claim.” The gain is small. PROVROUTE improves on the strongest baseline by only 2.07pp, without a reported confidence interval, and the gain is significant for only one of the four additional models (Table 9).
-
The real-world study seems too small to support the conclusions drawn from it.
The paper contains several typos, e.g., “can ne found” (line 502) and “Figure 3 a compares” (line 314).
[1] Diagnosing LLM Arbitration Behavior over Pre-evidence Epistemic States in RAG-based Fact-Checking. arXiv:2606.01120, 2026.
[2] ClashEval: Quantifying the Tug-of-War between an LLM’s Internal Prior and External Evidence. In Advances in Neural Information Processing Systems (NeurIPS), 2024.
[3] Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts. In International Conference on Learning Representations (ICLR), 2024.
[4] Context versus Prior Knowledge in Language Models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL), 2024.
[5] Task Matters: Knowledge Requirements Shape LLM Responses to Context–Memory Conflict. arXiv:2506.06485, 2025.
[6] Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation. In International Conference on Learning Representations (ICLR), 2023.
[7] Language Models (Mostly) Know What They Know. arXiv:2207.05221, 2022.
Questions for authors
How does PROVROUTE compare with a simple rule that verifies every response in which the model adopts the external claim?
Could Table 8 be reported separately for erroneous records and for correct updates? How much of the +24.77pp gain on correct updates comes from reduced abstention?