- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
BioTrace proposes an agent framework for whole-slide pathology VQA that combines a learned Gene–Pathway–Phenotype evidence space with multiscale visual acquisition and retrieval-augmented evidence verification. The evidence module is trained using phenotype annotations and paired RNA-seq, while inference relies on H&E images. The agent iteratively acquires predictions and visual observations, evaluates evidence sufficiency, and generates an answer from the accumulated evidence. The paper reports improvements on WSI-VQA and SlideBench-BCNB, which are promising.
Critical strengths
The paper addresses a relevant problem: making the evidence used by pathology VQA systems explicit and inspectable. Organizing predictions and visual observations into a structured reasoning process is a useful research direction.
The reported downstream results are promising. BioTrace achieves 60.93% overall accuracy on WSI-VQA and a 65.13% overall score on SlideBench-BCNB (Tables 1–2). The paper also includes component ablations and quantitative evaluations of phenotype, pathway, and gene prediction, providing evidence that the structured module captures useful predictive information.
Critical weaknesses
-
Limited experimental scope. Both evaluation benchmarks are restricted to breast pathology, and the evidence module is trained on TCGA-BRCA (Sec. 4.1). These experiments do not establish whether the learned biological relations and verification policy generalize across tumor types. This is a substantial limitation for the broadly presented framework, particularly because its phenotype vocabulary and Pathway–Phenotype relations may be disease-specific.
-
Insufficient validation of the biological evidence and verifier. I acknowledge the paired RNA-seq supervision and the authors’ distinction between predictions and measured assays. However, the inference-time molecular signals are predicted from the same WSI as the phenotype. Their agreement does not independently corroborate the biological interpretation. Aggregate prediction metrics and qualitative traces do not establish that the molecular evidence selected for individual answers is correct. Moreover, the verifier is not directly evaluated for its ability to identify erroneous, conflicting, or insufficient evidence. These gaps weaken the central claim of verifiable biological reasoning.
-
The ablations do not establish the necessity of the complex design. Table 3 shows that phenotype-only evidence already achieves 57.71% accuracy, compared with 60.93% for the full system. Removing the verifier reduces accuracy to 59.16%. These results suggest utility, but do not isolate the contribution of the biological hierarchy from access to supervised predictions or differences in evidence acquisition. A simpler baseline using the same supervision and inference budget, together with uncertainty estimates for the component gains, is needed.
Questions for authors
-
Generalization beyond breast cancer. Could the authors evaluate BioTrace on additional tumor types, for example using a representative subset of WSI-Bench introduced by WSI-LLaVA? Comparisons with relevant baselines would help assess whether the reported gains generalize to other cancers. Please also clarify any retraining or adaptation required. These additional results would help address my concern about the limited experimental scope.
-
Validation of biological evidence. Could the authors provide additional validation of the gene/pathway evidence selected to support individual answers, beyond aggregate prediction metrics? In particular, can the verifier reliably detect incorrect or conflicting molecular predictions? Targeted checks against held-out molecular measurements and controlled evidence perturbations would help substantiate the verification claim.
-
Contribution of the proposed components. Could the authors compare BioTrace with a simpler baseline using the same supervision and prediction targets under a comparable acquisition budget? This would help isolate the contribution of the biological hierarchy and verifier. Uncertainty estimates for the key ablation gains would also help assess their robustness.