- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses the difficulty multimodal language models face in reliably extracting diagnostic findings from multi-sequence breast MRI and proposes PCBreast. The authors construct MMBreast, a four-center dataset, and use image–report alignment and structured perceptual CoT fine-tuning to guide sequential analysis of morphology, enhancement kinetics, and signal characteristics. They then introduce PSPO, combining diagnostic accuracy and clinical description consistency rewards with visually sensitive token weighting. Evaluation covers BI-RADS classification, perceptual descriptions, component ablations, and missing-sequence experiments.
The paper presents a useful task-specific system. However, its two central contributions, the methodological advance and the claimed perceptual mechanism, currently lack sufficiently strong evidence.
Critical strengths
1. A dataset and task setup with practical value. The dataset contains over 7,000 examinations from four centers, pairing multi-sequence images with clinical findings and perceptual reasoning trajectories. It provides a valuable foundation for studying breast MRI classification and explanation generation. This is the contribution most likely to have lasting impact, although its value depends on adequate documentation of data quality, splitting protocols, and accessibility.
2. Controlled experiments provide some support for the training pipeline. Beyond the substantial gains over existing models in Table 1, Figure 7 shows incremental improvements within the same framework. Adding accuracy rewards, the perceptual rubric, and visually sensitive weighting to SFT increases accuracy from approximately 47.1% to 51.9%. These ablations support the practical benefits of the combined approach rather than relying solely on comparisons across models.
Critical weaknesses
1. The large gains in the main table do not establish a methodological advantage. The core algorithm contributes much smaller gains, and its contribution over prior work remains unestablished.
PCBreast receives alignment training, CoT supervision, and reinforcement learning on MMBreast. However, the paper does not establish that the baselines in the main comparison received comparable task-specific training. This leaves a basic question unanswered: do the gains come from the proposed method or from specialized training for breast MRI? The paper emphasizes an 18.52-percentage-point accuracy improvement over the strongest general-purpose baseline. Yet Figure 7(b) shows that visually sensitive token weighting, the most distinctive algorithmic component, increases accuracy only from 50.6% to 51.9% and Macro-F1 from 33.0% to 33.3%. These small gains do not seem sufficient to establish the effectiveness of the proposed token-weighting mechanism.
The methodological novelty is limited and insufficiently substantiated. Internalizing clinical diagnostic pathways through CoT supervision already has directly related precedents, including CogAlign. ToR uses absolute differences in token log-probabilities with and without images to identify perceptual tokens and reweight reinforcement learning signals. PGPO uses KL divergence between image-conditioned and text-only predictive distributions to reshape token-level advantages. The introduction and related work do not adequately examine the limitations of similar approaches or explain how the proposed method advances them. The experiments also lack comparisons with these closely related methods.
Furthermore, all experiments are confined to the single MMBreast test set, without an independent external cohort or an explicitly held-out hospital. The evaluation is therefore unconvincing and does not establish transferability or generalization. The per-hospital results in Appendix D cannot substitute for cross-hospital generalization testing.
2. The claimed improvement in genuine visual perception is not directly validated.
The paper does not clearly define how MRI slices, volumes, and DCE temporal information are represented in the model input. Perceptual evaluation primarily measures agreement with reference reports, and the reward even treats findings absent from the reference report as hallucinations. These results show that outputs better match reference text, but do not establish that the model identifies lesion features more accurately. The experiments in the introduction also fail to establish inadequate perception as the primary source of diagnostic errors.
Questions for authors
-
All experiments are conducted on MMBreast, and results reported separately for the four hospitals do not establish generalization to unseen data sources. Please add an external evaluation on at least one established public breast MRI dataset independent of MMBreast, comparing PCBreast with the main baselines under consistent input and evaluation protocols. Evaluate the existing models directly, without further training or tuning on the external test data, and report diagnostic or lesion-attribute recognition performance appropriate to the available annotations. Does PCBreast retain its advantage on this independent cohort?
-
What MMBreast training and clinical supervision did the Table 1 baselines receive? If they did not receive this training, please justify the fairness of the main comparison. Please also conduct fair evaluations on several additional established MRI benchmarks to assess generalization.
-
What evidence independent of the current report-matching rubric demonstrates improved recognition of actual lesion attributes? Among cases with diagnostic errors, how many contain expert-confirmed perceptual errors? How many diagnoses can be corrected by correcting those attributes?
4 comments
Response to Reviewer tP21 [Part-2/3]
External generalization. We add a cross-hospital OOD evaluation, training only on Hospitals 1–3 and holding out Hospital-4 from all training stages.
| Method | InternVL3.5 | InternVL3.5 | InternVL3.5 | InternVL3.5 | Qwen3.5 | Qwen3.5 | Qwen3.5 | Qwen3.5 | Qwen3.5-SFT | Qwen3.5-GRPO |
|---|---|---|---|---|---|---|---|---|---|---|
| Params | 1B | 2B | 4B | 8B | 0.8B | 2B | 4B | 9B | 2B | 2B |
| Accuracy | 0.0530 | 0.2119 | 0.1921 | 0.1656 | 0.2583 | 0.1854 | 0.2119 | 0.2517 | 0.2119 | 0.2848 |
| Method | Hulu-Med | Hulu-Med | Hulu-Med | Hulu-Med | Lingshu | MedGemma | HuatuoGPT-Vision | ClinFusion | Lingshu-SFT | PCBreast |
|---|---|---|---|---|---|---|---|---|---|---|
| Params | 4B | 7B | 14B | 32B | 7B | 4B | 7B | 8B | 7B | 2B |
| Accuracy | 0.1921 | 0.1987 | 0.1854 | 0.2119 | 0.1788 | 0.1987 | 0.1060 | 0.1854 | 0.2649 | 0.3113 |
PCBreast achieves the highest accuracy among the compared methods. This provides evidence of generalization to an unseen hospital.
Response to Weakness 2 (Model input and the link between perceptual deficiencies and diagnostic errors)
Model input. For each MRI sequence/volume, we feed groups of three adjacent slices into the visual encoder and concatenate the resulting visual tokens across groups and sequences. All sequences are processed in this way, including each temporal phase of DCE MRI.
Link between perceptual deficiencies and diagnostic errors. To explore how access to more reliable perceptual information affects diagnostic predictions, we provide clinical findings from medical reports alongside the MRI images and examine changes in PCBreast's previously misclassified cases. With these additional findings, 48.45% of the original errors are corrected. Combining the updated predictions with the unchanged predictions for previously correct cases yields the findings-assisted results below.
| Evaluation | Accuracy | Macro F1 | Weighted F1 | Hospital-1 | Hospital-2 | Hospital-3 | Hospital-4 |
|---|---|---|---|---|---|---|---|
| PCBreast | 51.89% | 33.33% | 49.66% | 47.71% | 52.25% | 65.71% | 34.44% |
| Findings-assisted correction | 75.20% | 59.93% | 75.22% | 77.06% | 73.03% | 87.62% | 64.24% |
| Change | +23.31 | +26.60 | +25.56 | +29.36 | +20.79 | +21.90 | +29.80 |
With findings-assisted correction, accuracy increases by 23.31 percentage points, both F1 metrics improve, and accuracy rises at all four hospitals. This recovery provides supporting evidence that more reliable perceptual information can help improve MRI-based breast cancer assessment.
Response to Reviewer tP21 [Part-3/3]
Response to Question 3 (Evidence for improved recognition of actual lesion attributes and diagnosis correction)
1. Evidence for improved recognition of actual lesion attributes. We additionally collect a breast MRI attribute-QA dataset with 100+ examinations and 900+ QA pairs for zero-shot evaluation. Questions cover lesion detection/localization, morphology and size, sequence-specific signals and enhancement kinetics, associated findings, and breast-level characteristics. Models receive MRI images and attribute questions; performance is measured by answer accuracy.
| Method | Params | Accuracy |
|---|---|---|
| PCBreast | 2B | 54.83% |
| Qwen3.5-GRPO | 2B | 54.16% |
| Qwen3.5-SFT | 2B | 53.94% |
| Lingshu | 7B | 53.39% |
| InternVL3.5 | 8B | 48.72% |
| HuatuoGPT-Vision | 7B | 44.73% |
| Qwen3.5 | 9B | 38.85% |
| Hulu-Med | 7B | 34.85% |
PCBreast achieves the highest zero-shot accuracy. This separate attribute-QA evaluation provides evidence beyond the current report-matching rubric, with modest additional gains over the task-adapted baselines.
2. Diagnostic correction. As reported in the findings-assisted correction table above (Response to Weakness 2), adding clinical findings alongside MRI images corrects 48.45% of PCBreast's original diagnostic errors. Combining these updated predictions with the unchanged predictions for previously correct cases raises accuracy from 51.89% to 75.20%.
The corrected cases span all five BI-RADS categories but are concentrated in the clinically challenging BI-RADS 4 category (63.25%), highlighting the value of reliable perceptual information for these difficult diagnostic assessments. BI-RADS 4 is particularly challenging because it encompasses a broad range of malignancy risk and includes both benign and malignant lesions with overlapping imaging features. The percentages below describe the distribution of all corrected cases.
| GT BI-RADS Category | Share of All Corrected Cases |
|---|---|
| 1 | 3.85% |
| 2 | 4.27% |
| 3 | 17.95% |
| 4 | 63.25% |
| 5 | 10.68% |
| Total | 100.00% |
The added hospital-held-out evaluation provides useful evidence of cross-center generalization. However, all results still rely on MMBreast’s task construction, annotations, and scoring protocol. The paper has therefore yet to establish whether the proposed perception optimization transfers to independently constructed breast MRI benchmarks. Please add an evaluation on a task-matched, independent public breast MRI benchmark, comparing PCBreast with SFT and GRPO under consistent input and scoring protocols, with no overlap with training data. This evaluation is needed to determine whether the reported gains depend on MMBreast-specific supervision and evaluation design.
Response to Reviewer tP21 [Part-1/3]
We thank the reviewer for the careful assessment and constructive suggestions. We appreciate the recognition of the practical value of MMBreast for breast MRI classification and explanation generation, and of the support provided by our controlled ablations for the combined training approach.
Response to Weakness 1, Questions 1 & 2 (Fair training comparisons, methodological novelty, and external generalization remain unestablished.)
Fair training comparisons. We agree that comparisons with off-the-shelf models alone cannot isolate methodological gains from breast MRI adaptation. We therefore add Lingshu-SFT and Qwen3.5-SFT trained on MMBreast, alongside PCBreast, as shown below.
PCBreast outperforms both task-adapted SFT baselines.
Methodological novelty. We acknowledge the precedents in clinical CoT supervision (CogAlign) and visual-dependent token optimization (ToR and PGPO). Our contributions lie in a multi-sequence breast MRI dataset and the designs for breast MRI perceptual enhancement, rather than these general techniques alone. The following table clarifies the differences in the designs described by these papers.