- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PathWeaver, a framework that represents pathology reasoning using structured diagnostic evidence graphs. It combines graph generation, node-level preference optimization, and graph-conditioned answer generation, with an extension for cross-patch evidence integration.
The authors evaluate the framework on multiple pathology QA benchmarks, including PathMMU and PanCancer, reporting improvements over existing VLM baselines. However, the independent contribution of graph structure to these improvements remains unclear.
Critical strengths
-
Structured diagnostic reasoning. The paper presents a coherent framework that uses explicit evidence graphs for fine-grained supervision, answer generation, and cross-patch integration.
-
Promising experimental results. The framework shows improvements across multiple pathology benchmarks. In particular, the cross-patch graph integration demonstrates practical potential beyond single-image reasoning.
Critical weaknesses
-
Insufficient validation of diagnostic evidence graphs. The paper lacks direct evidence that the generated graph nodes and relations are medically valid and faithfully grounded in pathology images. This weakens its claims about reliable and interpretable diagnostic reasoning.
-
Unclear contribution of graph structure. The ablation results show that graph conditioning alone provides inconsistent improvements, while most gains emerge after node-level preference optimization. The authors should demonstrate whether the relational graph structure itself contributes beyond node-level textual information and additional training.
Questions for authors
-
Could the authors clarify whether the generated diagnostic graphs have been independently evaluated for medical correctness and visual grounding?
-
Could the authors explain what evidence supports the independent contribution of graph relations, beyond node-level textual information and preference optimization? Are any relevant ablation results already available?
The paper presents substantial work and promising results, but its central research question is somewhat diluted by the number of components and applications. I encourage the authors to focus on the most compelling contribution, particularly cross-patch evidence integration, and provide deeper analysis of why explicit graph structures are necessary and how they improve diagnostic reasoning.
Summary Response
For ease of reference, we refer to reviewers PiNj, qN9x, Gv67, and UxM8 as R1, R2, R3, and R4, respectively.
We sincerely thank all reviewers for their thoughtful and constructive feedback, which helped us strengthen the experimental evaluation of PathWeaver. We particularly appreciate their recognition of:
A coherent representation for diagnostic reasoning. Reviewers recognized the value of explicitly structuring diagnostic evidence through graphs (R1–R4), particularly their use as a common representation for supervision, answer generation, and cross-patch evidence integration (R2–R4).
Fine-grained supervision of diagnostic claims. Node-level counterfactual preferences provide explicit learning signals for individual claims, and the training-stage ablations provide evidence of its contribution. (R2, R3)
A substantial pathology data resource. The harmonization of more than one million examples provides a consistent training resource and construction pipeline for pathology models. (R1)
Broad evaluation and promising cross-patch applicability. The experiments cover diverse pathology QA tasks, while training-free graph weaving extends the framework to integrating diagnostic evidence across tissue regions. (R1–R4)
We have addressed the reviewers' main concerns through additional experiments and clarifications. Below, we summarize the questions and corresponding updates.
Expert validation. Assessing medical correctness. (R1, R3, R4)
Addressed in Appendix R, where we collected and analyzed 1,408 ratings from seven pathologists covering nodes, edges, and final answers in single- and cross-patch settings. The analysis results support the medical validity of the generated graphs.
Contributions of graph content and structure. Assessing the roles of diagnostic evidence, graph connectivity, and relation semantics. (R1–R4)
Addressed in Appendix O, Tables 20–21, through:
(i) a linearized-text baseline using the same evidence nodes;
(ii) node-input removal and node-order randomization;
(iii) edge removal and random rewiring;
(iv) random relation labels and replacement of all supports relations with contradicts.
Contribution of NPO. Comparing NPO with full-sequence DPO under the same preference supervision. (R2, R3)
Addressed in Responses to R2 W2/Q2 and R3 W1/Q1, using the same 4B backbone and preference pairs. Standard full-sequence DPO suffered format degradation, adding auxiliary CE restored validity, but NPO still achieved higher validity and accuracy.
Model capacity and computational cost. Providing comparable single-VLM baselines and measuring inference cost. (R1, R3)
Addressed in Response to R1 W3/Q3 and Appendix P.1, Table 22, where we added Qwen3-VL-8B SFT+DPO and InternVL3-14B SFT comparisons and measured parameter counts, FLOPs, throughput, and GPU memory.
Multi-patch inference latency. Assessing how inference cost scales across patches. (R1)
Addressed in Appendix N, Tables 18–19, and Appendix P.2, Tables 23–24, comparing DAG formats in latency and downstream performance, and showing that PathWeaver's full pipeline took less than half the time of graph-free SFT processing.
Cross-patch aggregation. Comparing weaving with simpler aggregation of the same generator outputs. (R2, R4)
Addressed in Section 3.4, Table 3, where we added two conclusion-voting baselines using the same patch DAGs.
Safeguards of graph-weaving. Explaining the rule-based checks used during grid merging. (R3)
We clarified graph-weaving safeguards in Response to R3 Q3 and Appendix Q, Figure 7, and evaluated their effects alongside other post-merging steps in Table 25.
Together, these additions strengthen the evidence for PathWeaver’s medical validity, methodological contributions, and practical applicability, and hopefully addressed reviewers’ main concerns. We appreciate Reviewer PiNj’s and qN9x's positive reassessment and actively participating in the discussion. We sincerely thank all reviewers for their time and constructive feedback, which have helped us improve the paper.