- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces Evidence Utility Geometry, an exhaustive analysis of document-subset utility in RAG. It also compares answer likelihood with generated-answer quality, showing that their optimal evidence subsets can differ. However, the analysis and presentation need substantial development. It does not look like a version that is ready to be reviewed. These results are not yet developed into a sufficiently clear and compelling scientific narrative.
Critical strengths
- The exhaustive evaluation of all subsets within small evidence pools provides exact reference points for distinguishing budget-enforcement loss, offering a useful diagnostic perspective on RAG evidence selection.
Critical weaknesses
- The manuscript reads more like an automated experimental report than a well-developed research argument. It presents numerous violation rates, regret decompositions, and statistical comparisons, but provides limited synthesis explaining what new understanding emerges from these measurements.
- Similarly, the mismatch between likelihood and F1 is quantified, but the paper does not adequately characterize the cases driving this mismatch or derive concrete guidance for choosing an evaluation target.
- Substantial revision is needed to make this a good version for review.
Questions for authors
N/A