- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper converts existing pathology image–caption pairs into diagnostic question–answer pairs and reasoning supervision. It first extracts explicitly named diseases from captions, then generates and automatically audits disease descriptions, differential diagnoses, and diagnostic criteria to construct Verified Diagnostic Knowledge (VDK). Candidate questions are assigned to Easy, Hard-K, or Hard-V according to a probe model’s answers: correct with the target image alone, correct after adding disease knowledge, or correct after adding an auxiliary comparison image. A teacher generates rationales using the corresponding evidence, while the student receives only the target image and question. Training follows an Easy → Hard-K → Hard-V sequence. The paper constructs approximately 110,000 training examples and a case-disjoint benchmark, with additional evaluation on public pathology VQA datasets and PathMMU.
Critical strengths
-
The objective is clear and the pipeline is easy to understand. By transforming sparse descriptions into disease knowledge, questions, and reasoning processes, the method provides a concrete approach for reusing existing pathological image and text resources. The introduction of disease knowledge and reference images also ensures that the generated questions go beyond simple rewrites of the original descriptions.
-
The experiments cover multiple public benchmarks, benchmarks with non-overlapping cases, two model sizes, and multiple component ablation studies. On the PathMMU test set, the 3B and 7B models achieved improvements of 10.73 and 15.50 percentage points, respectively, over the baseline model. Stage-wise results further demonstrate the contributions of different training subsets.
Critical weaknesses
-
The explanation of the question generation process and its diversity is insufficient. The paper provides prompts for knowledge construction and review, but does not offer equally detailed explanations for initial question generation and the rewriting of difficult questions. Consequently, it remains unclear how question categories, wording, and answer formats are controlled, and whether a large number of samples follow similar question patterns. The provided category statistics are helpful but do not fully address this issue; this is particularly important for work where data construction is the primary contribution.
-
The difficulty labels rely on the probe answering incorrectly from the target image alone and correctly after receiving additional information. However, this change in correctness does not by itself establish that the question is genuinely difficult. The source and reliability of the additional knowledge and comparison images, and how the procedure distinguishes difficult questions from problematic ones, need further clarification.
-
Figure 1 appears to have been generated with AI, but the AI Use Statement mentions only language polishing and does not disclose its use in figure generation.
Questions for authors
-
How does the generation process ensure diversity in the questions, rather than repeatedly producing similar questions from different images? Please clarify how the process encourages variation in question content, wording, and answer format, and provide evidence that the resulting dataset is not dominated by a small set of recurring question patterns.
-
How do you distinguish genuinely difficult questions requiring additional knowledge or visual comparison from questions with ambiguous wording, insufficient information, or inappropriate reference answers? Beyond the criterion of failing with the target image alone and succeeding with additional information, are the final rewritten questions independently checked for answerability and reference-answer validity before admission to Hard-K or Hard-V?
-
Figure 11(b) includes Easy (no PT), Easy (PT), Mixed, and RL, although the paper states that no RL is used and the caption describes stage variants from Table 3. Please clarify which training configuration each set of bars represents and reconcile numerical differences, including the Easy score of 77.8 in the figure versus 77.20 in Table 3.