- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper presents MedFairVLM, a benchmark for evaluating fairness in medical multimodal LLMs. It evaluates 10 models on 8 datasets across different demographic groups, tasks, and settings. The paper also proposes a theoretical upper bound that decomposes fairness disparity into five sources of bias, and analyzes their correlations with model fairness.
Critical strengths
The experiments are relatively comprehensive, covering zero-shot, fine-tuning, and distribution shift.
Critical weaknesses
1: Limited novelty and scientific findings; Most conclusions are rather expected. Different demographic groups have different data distributions and model performance, and distribution shift may affect these groups differently. Similar issues have already been studied in medical AI fairness. The paper does not provide sufficiently new insights beyond these observations.
2: The proposed five bias sources do not really explain model unfairness; They are derived from data distributions and are model-independent. Therefore, the same five sources are shared by different MLLMs on the same dataset, even though their fairness behavior can be very different. More importantly, correlations between distribution differences and fairness gaps cannot establish which source actually causes unfairness. The paper does not provide controlled experiments to verify these causal relationships.
- The theoretical contribution is not well connected to the experiments: The upper bound is derived for FEMI, rather than the actual F1 or LLM-judge fairness gaps. In practice, the proposed estimators use MMD instead of the JS distances in the theorem, so the bound is not directly verified. Moreover, FEMI shows relatively weak correlations with the actual fairness gaps. It is unclear what additional understanding this theory provides.
4 The fairness evaluation may be confounded by clinical differences: Different demographic groups naturally have different disease prevalence and clinical characteristics. Even a model with identical sensitivity and false-positive rate across groups can have different F1 scores. The paper does not sufficiently distinguish such data heterogeneity from algorithmic unfairness. Therefore, some reported fairness gaps and bias sources may simply reflect differences in disease distributions.
Questions for authors
See the weakness.