- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces a problem: prior methods evaluate the quality of search agents only on the final answer, ignoring citation supports or source independence. The author proposes the CSEG framework to classify trajectories and a reward model.
Critical strengths
The paper identifies the gap in evidence grounding in search agents.
Critical weaknesses
- Although the performance has improved on CSEG-Bench, it is not clear that it can transfer to other benchmarks. It lacks experiments to show its transferability.
- The improvement on CSEG-Bench seems obvious to me: training and testing on the same benchmark.
- The major claim in the paper is not fully addressed. The paper and the experiments do not provide evidence to support the claim.
Questions for authors
- What is the preliminary setup mentioned in the introduction & RQ1? What is the dataset used, and how did the authors obtain the results?
- How are the trajectories generated using the 6-layer decision tree? Is it rule-based or LLM-as-a-Judge?
Author-Reviewer Discussion
Dear Reviewers,
The authors have provided the rebuttal. Please have a look and let the authors know if you need further clarification or still have follow-up questions.
Thanks, Your AC