- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes ARGUE, a training-free agent for whole-slide image question answering. It represents observed findings, diagnostic concepts, and answer-support/refutation relations in an uncertain evidence graph shared across evidence acquisition, sufficiency assessment, and answer generation. A Monte Carlo diagnostic-reachability score guides patch acquisition and stopping. Experiments on three WSI-VQA benchmarks compare ARGUE with agentic baselines and include graph/component ablations and robustness analyses; the authors report the best aggregate results among the tested systems.
Critical strengths
- Preserving explicit links from morphological findings through concepts to candidate answers is a relevant response to the evidence fragmentation of multi-stage WSI agents. The graph is used throughout the pipeline rather than only added as a post-hoc explanation.
- The paper tests its central representation through ablations that remove pathway structure and vary relation-probability assignments. This provides more direct evidence for the graph and reachability components than a system-level comparison alone.
Critical weaknesses
- The uncertain relations and their validity probabilities are generated by an LLM, yet the paper does not establish that these probabilities are calibrated to diagnostic correctness or that edge dependencies are adequately modeled. Since reachability is the central decision signal for both acquisition and stopping, systematic errors in these estimates can undermine the method's main premise. Ablations against random or text-similarity probabilities do not establish clinical calibration.
- Evaluation is based on benchmark answer accuracy and model-driven evidence construction, rather than expert-annotated diagnostic pathways or a prospective clinical decision setting. The results support a promising WSI-VQA agent, but do not yet validate that diagnostic reachability reflects medically sound evidence sufficiency. Existing training-free approaches such as PathNavigate[1] also address evidence acquisition; a stronger comparison on matched budgets and independently assessed evidence quality would clarify ARGUE's incremental contribution.
[1] Yang, Chunze, et al. "PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA." arXiv preprint arXiv:2605.23559 (2026).
Questions for authors
- How are relation-validity probabilities elicited, and have they been calibrated or compared with independent pathologist judgments? Please specify whether the Monte Carlo computation assumes independent edge validity and how sensitive decisions are to violations of that assumption.
- Are the main baseline comparisons matched for inspected-patch/token budget and LLM calls? If not, what remains of ARGUE’s advantage under a matched inference budget?
I appreciate the detailed reply from the authors and the effort made during the rebuttal phase. My concerns are now addressed and I would like to maintain my recommendation of acceptance.