- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Traditional diagnostic evaluations are limited as they only study accuracy, ranking quality, or validate reasoning steps. This does not disentangle the LLM’s responsiveness to evidence and the role of the disease prior / prevalence. The authors propose to fit a linear model with two features over a set of diagnosis tasks, where one feature contains the disease prevalence and the other feature contains the evidence. The coefficients are fit using a Placket-Luce likelihood using the observed diagnosis rankings from a given model. This would disentangle whether the model is responding to evidence or just diagnosing based on prior disease prevalence. The paper provides various diagnostics to show that the evidence sensitivity coefficient is correlated with accuracy, the ability to incorporate evidence of varying strength independent of the stated disease prior, and the ability to revise a diagnosis.
Critical strengths
-
Investigating whether LLMs rely on disease priors versus actual clinical evidence is an essential question for safe medical deployment.
-
The decomposition and insights are helpful for understanding a primary benchmark based on the specific featurization of evidence level. The authors evaluate sensitivity to evidence-level featurization and data distribution using two different benchmarks, showing that model ordering based on the coefficient can translate.
-
The authors evaluate across 25 LLMs and demonstrate that the proposed evidence responsiveness coefficient is strongly correlated with various model properties such as diagnostic accuracy with statistical significance. There is also strong experimental validation regarding the sensitivity of the coefficient to various design decisions.
Critical weaknesses
-
The main motivation of the paper is that standard accuracy metrics fail to reflect evidence responsiveness. However, the empirical results seem to contradict this premise. Specifically, appears highly correlated with Top-1 accuracy, while the prior coefficient shows no correlation. While the paper's proposed decomposition was valuable for uncovering this relationship, doesn’t this suggest that Top-1 accuracy already serves as a strong proxy for evidence responsiveness in practice? Or if certain models actually have a high and low , this would be an interesting finding and also useful to substantiate the practical necessity of this decomposition in uncovering weak models that standard accuracy metrics miss.
-
While evidence responsiveness measures whether a model’s diagnostic ranking is sensitive to evidence, it does not evaluate whether this sensitivity translates to accurate or well-calibrated disease diagnosis. Other diagnostic methods can be used to validate whether evidence is incorporated in the wrong direction or the model is miscalibrating its confidence relative to evidence strength. For example, one can directly assess evidence responsiveness and diagnostic accuracy across varying evidence strengths (e.g., via a similar setup to Section 4.3 / Δ_E) without needing to fit a Plackett-Luce coefficient. While the various diagnostics proposed in the paper are useful for understanding aspects of evidence sensitivity, it remains unclear how practitioners should interpret or act upon the sensitivity coefficient itself.
Questions for authors
-
To better highlight the problem, were there combinations of models and diagnostic benchmarks that the decomposition caught where the was high and was low, but top-1 accuracy was high?
-
Could the authors clarify how an aggregate evidence responsiveness coefficient should be preferred over more granular diagnostic evaluations? Specifically, a single global coefficient computed across diverse diagnostic tasks (based on a specific featurization of evidence-level) may mask failure modes. In clinical contexts, evaluating responsiveness at a fine-grained level, such as across specific disease categories, evidence types and strengths, may be more actionable for identifying where a model fails to incorporate evidence. My concern is whether a single aggregate sensitivity coefficient provides actionable insights or safety guarantees to practitioners.
Clarification requests and missing details:
- is defined in the methodology section, but it is never explicitly used or referred to in the subsequent equations or text. Could the authors clarify its role or remove it if redundant?
- Are the set of ranked candidate diagnosis (or just the number of candidates) fixed across all tasks ? My understanding is that a single set of coefficients is fit across all diagnostic tasks irrespective of confounding factors such as task difficulty. Did you consider a more granular alternative of fitting coefficients separately across tasks?
- How is the evidence feature standardized across heterogeneous diagnostic tasks? In Section 4, the paper mentions that the evidence feature is based on a log-likelihood ratio score, but it remains unclear how this is computed in practice. Specifically, how are evidence strengths normalized so that they exist on a comparable scale across different diseases and clinical domains?