- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a training-free framework for medical image diagnosis built on frozen multimodal large language models. It first retrieves similar training images with a visual encoder to build in-context examples. It then diagnoses through two pathways: one predicts clinical concepts and infers the class from them, and the other predicts the class directly from the image. Both pathways remove the class-frequency prior to address long-tailed data, and their outputs are fused with Dirichlet evidence and Dempster–Shafer theory, which also yields an uncertainty score. Experiments on dermoscopy, chest X-ray, and fundus datasets with three backbones report the best results on two datasets and show that uncertainty is associated with prediction correctness.
Critical strengths
1 Trustworthy medical AI is an important research direction, especially when large language models may produce confident but incorrect diagnoses. The paper addresses this challenge without requiring expensive model fine-tuning, which is practically attractive.
2 The proposed dual-pathway design is reasonable. The concept pathway provides interpretable concept-level reasoning, while the visual pathway preserves direct visual information. Combining these complementary signals through evidence fusion is a meaningful design choice.
Critical weaknesses
1 The central claims of trustworthiness and hallucination detection are not supported. By construction, the uncertainty of the visual pathway depends only on the gap between the largest logit and the remaining logits. That gap is itself a conventional confidence score, which contradicts the claim that conventional confidence cannot separate correct from wrong predictions. The evidence consists of a modest difference in mean uncertainty between correct and wrong predictions, with no standard error-detection or selective-prediction metrics and no comparison against simple confidence baselines.
2 Novelty is limited, and the performance claims are not robust. The method mainly combines retrieval-based in-context learning, logit adjustment, and an existing evidential fusion scheme. On DDR, the dataset that best reflects the long-tail problem, CBVLM with Idefics3 achieves a higher Macro-F1 and a comparable BACC, which the text does not acknowledge. With test sets of a few hundred images, a single split, and no variance reported, gains of a few points are hard to confirm. A simple baseline that votes over the labels of the retrieved neighbors is also missing.
Questions for authors
1 How is the "traditional confidence" in Figures 1 and 4 computed
2 On DDR, why does the text omit that CBVLM with Idefics3 reaches a higher Macro-F1, and can you report per-class results for the minority grades and variance across splits?
3 Can the authors provide stronger evidence that the proposed uncertainty specifically detects hallucination rather than simply correlating with prediction difficulty?
4 Can the authors provide qualitative case studies showing the full reasoning pipeline, including retrieved examples, predicted concepts, pathway outputs, evidence fusion, and final uncertainty?
3 comments
Response to Reviewer qbTU [2/3]
[2/3] Due to the character limit, this response is split into three parts. This is part 2/3.
Weakness 2 and Question 2:
1. Methodological contribution
Our framework addresses two challenges in medical image diagnosis with frozen LVLMs: hallucination and bias toward common classes under long-tailed class distributions.
To mitigate hallucination, we design two complementary pathways because incorrect clinical findings predicted by a frozen LVLM can mislead the diagnosis. The concept matching pathway infers a diagnosis from predicted clinical findings and class-conditional concept statistics, while the visual perception pathway predicts the diagnosis directly from the image. Without training a separate evidence estimator, we use debiased class probabilities to allocate evidence across classes and sample-dependent logit gaps to determine the initial strength of that evidence. Because incorrect concept predictions can also have large logit gaps, we downweight concept evidence before fusion when the predicted findings conflict with co-occurrence patterns estimated from annotated data. The fused uncertainty reflects both pathways’ evidence strengths and the disagreement between their diagnostic predictions.
To mitigate long-tail bias, we introduce a separate prior correction strength for each pathway because class bias in a frozen LVLM’s outputs may differ from the bias implied by the empirical class frequencies of the target dataset. The concept-matching pathway adjusts the explicit class prior in its Bayesian diagnosis, while the visual-perception pathway adjusts the class probabilities derived from the frozen LVLM’s logits. This lets us control the degree of prior correction separately for each pathway.
Our experiments and ablation studies support the effectiveness of these designs in improving diagnostic performance and the reliability of uncertainty estimates.
2. Comparison of per-class ACC
We will revise the DDR discussion to explicitly report that CBVLM with Idefics3 achieves a higher Macro-F1 than our method with CheXagent, while the two configurations have comparable BACC. These are the backbones with which each method achieves its highest Macro-F1 on DDR. To explain this difference and assess performance on the minority classes, we report per-class ACC and F1 for both methods using Idefics3 on the same DDR test split.
| Samples | Ours | CBVLM | |||
|---|---|---|---|---|---|
| ACC (%) | F1 (%) | ACC (%) | F1 (%) | ||
| No DR | 219 | 73.06 | 78.24 | 98.17 | 96.85 |
| Mild | 30 | 63.33 | 52.05 | 53.33 | 50.79 |
| Moderate | 120 | 53.33 | 53.78 | 79.17 | 80.17 |
| Severe | 14 | 64.29 | 51.43 | 42.86 | 46.15 |
| Proliferative | 21 | 66.67 | 52.83 | 47.62 | 52.63 |
Our method achieves higher ACC and F1 on all three minority classes: Mild, Severe, and Proliferative. The F1 losses on No DR and Moderate outweigh the gains on the three minority grades, explaining the lower overall Macro-F1.
3. Variability across data splits
To assess how sensitive our method is to the choice of data split, we evaluated it with CheXagent on five DDR splits. The first is the official split, and the other four follow the same training, validation, and test set proportions, and the proportion of the sample sizes in each category across the three sets is also consistent. We report the results for each split and the mean and sample standard deviation across the five splits. These results quantify the method’s sensitivity to the choice of data split.
| Split | BACC (%) | Macro-F1 (%) |
|---|---|---|
| Split 1 | 64.36 | 61.63 |
| Split 2 | 62.88 | 61.98 |
| Split 3 | 70.65 | 64.43 |
| Split 4 | 71.06 | 65.16 |
| Split 5 | 67.79 | 63.39 |
| Mean ± Std | 67.35 ± 3.67 | 63.32 ± 1.52 |
4. Retrieved-neighbor voting baseline
We evaluated a KNN () baseline on the original splits of all three datasets. We retrieve the four closest training images using frozen MedImageInsight features, then predict the label with the most votes. In a tie, we select the label of the closest neighbor among the tied classes. The BACC and Macro-F1 scores achieved on the three datasets are shown in the table below.
| Method | Derm7pt | CORDA | DDR | |||
|---|---|---|---|---|---|---|
| BACC (%) | Macro-F1 (%) | BACC (%) | Macro-F1 (%) | BACC (%) | Macro-F1 (%) | |
| KNN () | 82.60 | 83.45 | 67.14 | 73.85 | 52.26 | 59.64 |
| Ours-best | 88.09 | 85.13 | 78.70 | 78.43 | 64.36 | 61.63 |
Response to Reviewer qbTU [3/3]
[3/3] Due to the character limit, this response is split into three parts. This is part 3/3.
Question 1:
In Figures 1 and 4 of the original submission (now Figure 6), “traditional confidence” is the maximum class probability of the final fused distribution, computed from the Dirichlet mean in Equation 12. This is the probability assigned to the final predicted class. The fused uncertainty reflects the total evidence supporting the diagnosis, so predictions with the same confidence can have different uncertainty values.
Conventional softmax confidence is typically computed from a classifier’s output logits, such as those of our visual pathway. For a fair comparison on the same final predictions, we use the maximum class probability after Dirichlet evidence fusion as the confidence baseline in our experiments.
Question 2:
See the response of weakness 2.
Question 3:
In our setting, hallucination can manifest as a prediction about an imaging finding that disagrees with the reference annotation. To examine how fused uncertainty responds to such errors, we compare the predicted clinical concepts with the reference annotations for each image. Figure 5 in Appendix L shows six selected cases from Derm7pt, CORDA, and DDR. In each case, the final diagnosis was correct, at least half of the clinical concepts were predicted incorrectly, and exceeded the corresponding test-set mean.
For example, in the bottom-left DDR panel in Figure 5, the concept pathway predicted hemorrhages, hard exudates, and microaneurysms, all of which were annotated as absent (red boxes 1–3). The fused prediction correctly classified the image as No DR, with , above the DDR test-set mean of 0.2338. In this case, the hallucinated findings contributed to elevated fused uncertainty even though the final diagnosis was correct.
Question 4:
We will include three qualitative cases showing the full diagnostic pipeline in Appendix F. In one CORDA case (Case 2 in Figure 3) evaluated with CheXagent, all four retrieved reference images were labeled COVID-19. The concept matching pathway predicted enlarged cardiomediastinum as present and the other seven findings as absent: cardiomegaly, lung opacity, edema, consolidation, pneumonia, pneumothorax, and pleural effusion. Based on these concept predictions, the concept matching pathway assigned a COVID-19 probability of 36.1% and predicted no COVID-19, while the visual perception pathway assigned a probability of 71.8% and predicted COVID-19. The visual pathway provided stronger evidence, and the conflict between the two pathways was 0.1270. After fusion, the COVID-19 probability was 61.66% and the final uncertainty was 0.2251. The fused diagnosis was COVID-19, matching the reference label.
Response to Reviewer qbTU [1/3]
[1/3] Due to the character limit, this response is split into three parts. This is part 1/3.
Thank you for your helpful suggestions and comments. We respond to the comments point by point in order below.
Weakness 1:
The visual logit gap can be used as a confidence score and determines the evidence strength of the visual pathway. To assess the reliability of the final diagnosis, we use the fused uncertainty, uFused, which also depends on the concept evidence after conflict-based downweighting and on disagreement between the two pathways. Thus, two samples with the same visual logit gap can receive different fused uncertainty scores.
To evaluate the reliability of uFused, we compare it with Confidence for detecting incorrect diagnoses on DDR using Qwen3-VL 8B. Both scores are evaluated against the same final diagnostic predictions and ground-truth labels. We sort samples independently by increasing uFused and decreasing Confidence, then divide each ranking into five approximately equal-sized, non-overlapping quintiles. The first quintile contains the predictions ranked as most reliable by each score. We report the diagnostic error rate within each quintile. In the first quintile, the diagnostic error rate is 2.47% when ranked by uFused and 17.28% when ranked by Confidence.