- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PathTIDE couples a pretrained VLM (Qwen3.5-9B) with a pathology foundation model (MUSK) while preserving the VLM’s native visual pathway. Native visual tokens query projected MUSK patch tokens via cross-attention, and a learned gated residual injects pathology evidence without changing the native token layout. Training first aligns MUSK to a frozen Qwen3-VL-Embedding-2B teacher on PathGen-1.6M, then applies SFT and GRPO with a 9:1 expert-active/expert-bypassed schedule. Evaluation on PathMMU, SlideBench-VQA-TCGA, SlideBench-VQA-CPTAC, and closed-ended WSI-Bench reports accuracy with 1,000-resample bootstrap CIs, plus ablation and linear-probe results.
Critical strengths
PathTIDE addresses a clearly motivated integration problem: it keeps the pretrained VLM’s native visual-token layout and visual-language interface while adding a separately encoded pathology foundation model as a complementary expert. This is consequential because it avoids rebuilding multimodal coupling or replacing the native pathway, and makes the pathology branch modular and interchangeable in principle.
The matched post-training ablation is a substantive strength. Comparing the base model, matched pathology post-training, replacement of the General Expert Branch, ungated residual addition, and full gated fusion under the same backbone and evaluation protocol goes beyond reporting a single high-scoring system and attempts to attribute gains to native-pathway preservation and learned gating. The PFM-Free/PFM-Full comparison using the same final checkpoint further helps separate the complete expert-enabled route from the residual update alone, strengthening the paper’s internal argument.
Critical weaknesses
The PathMMU result is implausibly high relative to all published frontier systems and human experts, and the paper provides no per-question evidence to verify it. PathTIDE reports 0.869 on PathMMU, whereas the benchmark’s original human-expert baseline is 71.8% and its zero-shot baseline is 49.8%; recent independent literature reports the strongest frontier systems at 76.8%, with other reported systems between 63.97% and 72.3%. A 9B-parameter open model outperforming all reported frontier systems and human experts by this margin requires direct verification. Without sample-level predictions (question ID, gold answer, model answer), the paper cannot rule out that a substantial fraction of correct answers is driven by language priors, option patterns, or benchmark noise rather than visual pathology evidence, and this matters because the paper’s central empirical claim rests on this result.
The TCGA-derived evaluation benchmarks overlap with the TCGA-derived training corpus at the patient level, and the paper’s decontamination does not address this. PathGen-1.6M, used in both training stages, is TCGA-derived, and independent audits report case-level overlap of 83.1% between PathGen-1.6M and SlideBench-VQA-TCGA and 90.7% between PathGen-1.6M and WSI-Bench-test. The paper’s decontamination is slide-ID-level only; it does not exclude different slides from the same patient, and it cannot be applied to patch-level PathGen data, which lacks slide identifiers. The reported gains on SlideBench-VQA-TCGA and WSI-Bench may therefore be inflated by patient-level leakage rather than pathology reasoning ability, and this matters because two of the four main benchmarks are TCGA-derived, so the headline WSI claims are not supported by patient-disjoint evaluation.
Questions for authors
PathTIDE reports 0.869 on PathMMU, while the benchmark’s human-expert baseline is 71.8% and the strongest published frontier systems do not exceed 76.8%. Please provide sample-level prediction files (question ID, gold answer, model answer) for PathMMU and report accuracy on a visual-evidence-necessary subset. Without this, a reader cannot determine whether the result reflects pathology reasoning or reliance on language/option priors.
PathGen-1.6M is TCGA-derived, and independent audits report case-level overlap of 83.1% with SlideBench-VQA-TCGA and 90.7% with WSI-Bench-test. Please specify how decontamination is performed at the patient and TSS levels, and how PathGen-1.6M patches from overlapping TCGA cases are excluded given that patch-level data lack slide identifiers. A patient-disjoint evaluation is needed to support the SlideBench and WSI-Bench claims.