- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes StageAdmit, an evidence admission framework for multi-agent search that distinguishes evidence utility for continued search and final-answer generation. It retains all collected evidence and learns separate admission policies for the two stages using keep–mask comparisons of downstream utility. Experiments on WideSearch and GISA show improvements in answer quality and inference efficiency.
Critical strengths
- S1: The paper distinguishes evidence utility for continued search from that for final-answer generation, offering a novel perspective on multi-agent search and motivating separate admission policies for the two stages.
- S2: The results show consistent quality gains across two benchmarks and three backbones through stage-specific evidence admission, alongside reductions in tool calls and writer input.
Critical weaknesses
- W1: The paper lacks analysis of how predicted utility relates to actual evidence contributions. Figure 5(c,e) shows that Item-F1 declines as positive thresholds increase, but it remains unclear whether this reflects the cumulative loss of many small-gain items or the exclusion of important evidence whose utility is underestimated.
Questions for authors
- Q1: Can you provide concrete examples of the same evidence item with its measured utilities at both stages, explaining why it helps one stage but not the other? These examples would help interpret the reported stage-specific utility differences.
- Q2: If a slightly positive threshold reduces admission without affecting Item-F1 in Figure 5(c,e), would it offer a better quality–cost trade-off than zero? Does this suggest that near-zero utilities are systematically overestimated, or are the marginal gains simply too small to be visible in the aggregate results?
Author-Reviewer Discussion
Dear Reviewers,
The authors have provided the rebuttal. Please have a look and let the authors know if you need further clarification or still have follow-up questions.
Thanks, Your AC