- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
BEYONDPATH addresses whole slide image question answering through a question agnostic Morphology Bank, question conditioned retrieval over all foreground patches, and evidence queried fusion into 96 visual tokens. The Bank is trained using multiple answers per training slide before retrieval and fusion are learned. The paper reports 0.769 WSI Bench Avg-9, 0.639 zero shot SlideBench BCNB accuracy, and leading results across eight report generation metrics using the same checkpoint. The contribution is a useful organization of complementary visual information, supported by substantial controlled experiments.
Critical strengths
-
The architecture makes a meaningful distinction from HistoSelect, published at CVPR in June 2026. HistoSelect selects patches within question selected tissue groups. BEYONDPATH separately learns a question independent morphological representation and lets the question search the full foreground set. The Bank and evidence streams have clearly specified, different roles.
-
The controlled evidence goes beyond removing individual modules. The full model exceeds single stream scoring, Bank restricted retrieval, a learned resampler, and direct concatenation with twice as many language side visual tokens. Appendix C documents retraining versus inference interventions and supplies complete task metrics. These comparisons support the practical value of the proposed interface.
-
The evaluation includes focused answers, report generation, and transfer to BCNB. The appendix carefully specifies patient grouped validation, semantic prompts, selection recurrences, and frozen modules. It also distinguishes compact decoder context from full slide retrieval cost and reports inference timing including the Bank construction repeated for every request.
Critical weaknesses
-
Baseline provenance remains incomplete at the row level. Section 4.1 says published baselines follow their official protocols, and Appendix A.3 explains reproduced general model scores. However, the pathology entries in Tables 2 and 3 lack exact source tables or evaluation checkpoints and a clear indication of which results were imported or recomputed. This leaves the training cohort and evaluation comparability difficult to assess.
-
The prevalence of the proposed Relevance-Sufficiency Gap is not quantified. Random and wrong slide Banks are inference interventions, so their degradation shows Bank dependence without uniquely identifying recovery of missing supporting morphology. The retrained architecture controls and qualitative cases support the practical complementarity of the two streams, and Appendix F appropriately acknowledges the lack of systematic localization validation. The remaining limitation therefore concerns the scope of the proposed mechanism explanation rather than the validity of the system results.
Questions for authors
-
For each pathology baseline in Tables 2 and 3, which checkpoint, source table, or reproduced evaluation produced the score, and which training cohort and answer mapping were used?
-
If feasible, can the existing case analysis be extended to quantify when the Bank supplies cues complementary to Focus? This would provide additional support for the proposed mechanism explanation.
3 comments
Thanks the authors' detailed rebuttal, including clarifications regarding the reviewer's concerns. I recommend the authors to include these details in the final version of the paper.
I will keep my score of 3 (weak acceptance).
Thank you for your support of our work, and we are very grateful for it.
We appreciate your valuable feedback and support of our work. We hope the following clarifications and additional results address your concerns. W = Critical Weaknesses, Q = Questions For Authors.
To Q1 & W1:
We have added the table below as Table 6 in Appendix A.3, marked in green. Tables 2 and 3 below refer to the manuscript tables.
Answer mapping. For generative BCNB baselines, we extract the final answer, normalize case, and remove non-semantic surrounding whitespace, quotation marks, and terminal punctuation while preserving symbols that form part of class labels. The normalized answer is mapped to the official label vocabulary of the corresponding task; ambiguous or unmappable final answers are counted as incorrect. When answers are represented as option letters, the mapping follows the option ordering of each individual question.
TITAN is evaluated as a frozen zero-shot image–text classifier using its official visual encoding and classification interfaces. Separate class text prototypes are constructed for the seven BCNB tasks. The class with the highest image–text similarity is mapped to the corresponding option in each question, accounting for question-specific option ordering. This procedure does not involve answer-text generation or generative answer normalization.
Report-generation evaluation. Report generation does not require class-label mapping. For report-generation results computed in this study, models are evaluated on the same official 208-WSI test list and corresponding reference reports. BLEU-1/2/3/4, ROUGE-L, and METEOR are computed using the official WSI-Bench evaluation scripts. WSI-Precision and WSI-Relevance use the GPT-4o claim-scoring prompts released with WSI-LLaVA at temperature zero. Results taken directly from prior publications retain the training and evaluation settings of their cited sources and are not re-normalized or re-scored in this study.
wisdomik/Quilt-Llava-v1.5-7b; Table 3: taken from WSI-LLaVA Table 3General-Medical-AI/SlideChat_WeightLucas-yuc/wsi-llava-v1.5-7b-e1; Table 3: taken from WSI-LLaVA Table 3Sunanhe/MedDr_0401MahmoodLab/TITANand CONCH v1.5google/medgemma-1.5-4b-itWenchuanZhang/Patho-R1-7BBastech/MLLM-HWSIhistoselect_wsi-llava.pthand the official SlideChat stage-2 warmstartTo Q2 & W2:
We have added a blinded two-pathologist study in Section 4.4 and Bank-content interventions in Appendix C.7. We randomly sampled 60 test slides and two eligible closed-ended questions per slide. The pathologists independently assessed evidence sufficiency, agreeing on 106/120 questions (Cohen's κ=0.839), with the remaining assignments resolved by discussion.
Focus alone was insufficient for 55/120 questions. The Bank supplied complementary cues for 40 of these questions, accounting for 33.3% of the annotated sample. On these 40 questions, Full achieves 82.5% accuracy, compared with 42.5% for retrained Focus-only and 47.5% with Bank updates off in the same checkpoint.
Replacing the pathologist-identified supporting Bank patches reduces accuracy to 52.5%, whereas equal-count replacement of other patches retains 80.0%. Across all 120 questions, Full corrects 20/40 errors made with Bank updates off and changes 4/80 correct answers to errors. These results quantify the occurrence of complementary Bank cues and support their contribution to answer accuracy.