- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduced LedgerRL, a strategy that trains one shared policy with claim-level rewards that discount copied claims and count only answer-used claims toward quantity credit. The experiments primarily utilize Qwen3-8B, employing GRPO training on MedQA questions that lack evidence labels, followed by zero-shot transfer evaluation on HotpotQA, 2WikiMultihopQA, and MuSiQue. The authors define a metric, TC@k, which requires that a given response simultaneously satisfies three conditions: the answer must be correct, the citation path must cover all gold-standard evidence, and each verification unit must cite between 1 and k sources. In this process, the study identifies and analyzes "reward shortcuts" that emerge within specific retrieval-and-citation training configurations. To address this, the authors propose the use of addressable intermediate "claim" records and protective rewards, which improve the extent to which complete evidence is incorporated into the answer path. However, it has not yet been demonstrated that these improvements consistently translate into final answers that are more accurate, easier to verify, or more cost-effective.
Critical strengths
-
Distinguishing between "incorrect answer," "no retrieval result," and "retrieval occurred but failed to lead to the correct answer path" provides diagnostic value.
-
Protective rewards are indeed effective within the same protocol, particularly the "anti-copy" component.
-
There is a degree of decoupling between the training reward and the evaluation against external evidence.
-
The authors provide a thorough disclosure of negative results and the limitations of their metrics.
Critical weaknesses
1.A simple yet powerful search rule has outperformed the full-fledged method, leaving the necessity of LedgerRL in question.
A "flat" model—devoid of reinforcement learning (RL) and augmented only by four specific search rules—surpasses the original LedgerRL across several core metrics. When both approaches are constrained to the same four search rules, "Cited-RL" achieves a TC@∞ score 5.9 percentage points higher than LedgerRL (95% CI [3.6, 8.4]). Given that such results can be attained through simple search constraints alone, what unique, irreplaceable benefits do the three-stage ledger structure and its associated RL training actually provide?
2.The advantage of primary metrics often hinges on format-specific verification units, yet training based on these metrics fails to yield consistent improvements in the verifiability of the final answers.
The C@2 metric employs different units depending on the format: for "Ledger," it uses intermediate claims cited by the answer, while for "Flat," it uses the final rationale items. A more robust verification approach should utilize semantically defined units that are consistent across all formats, while simultaneously assessing the extent to which the answer is supported by evidence.
3.While "anti-copy" is an effective regularization term in current systems, there is a lack of independent evidence regarding its utility—specifically, whether it represents a generally applicable principle for ensuring traceability.
A small-scale, validated paired analysis could be useful here: by comparing verbatim extractions (which are sometimes necessary), paraphrases that add no new information, and intermediate conclusions that genuinely synthesize multiple pieces of evidence, one could determine whether the reward mechanism makes appropriate distinctions.
4.Major concern: The existing datasets are insufficient to support the core narrative of the paper.
While the paper aims to address the issue of whether evidence can be reliably traced and verified in complex, high-stakes scenarios, the experiments primarily test whether models can locate and cite a small number of pre-annotated pieces of evidence within a short-answer question-answering (QA) framework. These two concepts are related, but they are not the same problem.
4.1 The retrieval environment is highly simplified. As explicitly stated in Appendix A, the testing does not involve open-ended searches across real-world repositories—such as medical literature, the internet, or collections of financial reports—but rather retrieval from a static BM25 index constructed from the contexts provided by the benchmark itself.
4.2 The integrity of the evidence path is reduced to a matter of "source coverage" from a predefined set of origins. In the context of multi-hop QA tasks—which are relatively short and rely on a limited number of "gold-standard" sources—this approach may measure source coverage, but it fails to adequately assess the semantic correctness of complex chains of evidence.
4.3 FinQA, which most closely resembles real-world financial document analysis, is excluded from the primary evaluation metrics. The authors explain in Appendix J that, since no method achieves an Exact Match (EM) score exceeding 3.5% on FinQA, it was omitted from the main "traceable" (TC) evaluation. Consequently, because current systems struggle to perform complex numerical reasoning based on financial documents and tables, the paper fails to demonstrate how the proposed method achieves traceable reasoning in such scenarios.
Questions for authors
Same as weaknesses