- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies why search agents can answer incorrectly even after retrieving relevant evidence. EAV archives tool observations and maintains a compact evidence chain of the claims, sources, and conflicts adopted during execution. An independent tool-using verifier checks high-risk premises in a fresh context, and rejected candidates trigger diagnostic re-execution with the existing evidence memory. EAV-Flash verifies complete tasks, while EAV-MAS verifies subtask handoffs. Experiments on four search benchmarks with multiple backbones report a favorable accuracy-token trade-off. Across nine matched settings, EAV-Flash achieves 82.64% average success, compared with 78.95% for MiroFlow.
Critical strengths
- The design is well motivated by concrete failure analysis. The observed failures distinguish retrieving evidence from inspecting and using it, and highlight the propagation of incorrect intermediate premises. Archiving, claim anchoring, and independent verification directly address these issues, making the system design coherent and practically relevant.
- The empirical evaluation covers multiple backbones, four benchmarks, token consumption, and paired component analyses. EAV-Flash improves average success by 3.69 points over MiroFlow while substantially reducing reported token use on the open-web benchmarks. The ablations and error analysis provide useful evidence for the value of anchoring and verification.
Critical weaknesses
- The distinct contribution relative to existing verification and fact-memory systems, including Co-Sight, FineVerify, and ArcticSwarm, needs clearer differentiation.
- Verification also triggers re-execution, so its measured gain combines checking with additional execution. A clearer comparison of capabilities and controls under comparable total compute would better attribute the gains to the proposed evidence-chain mechanism.
- AI Use Statement is missing. ICLR requires this. Please add this to avoid desk rejection.
Questions for authors
- Nearly all the references are not correct. Check differences among \cite{} \citep{} and \citet{}.