- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces MEDCOBE, a simulation framework for evaluating LLMs as clinical collaborators rather than as standalone decision makers. The main observation is that models that solve a case reliably on their own can still hurt the final decision once another decision maker enters the loop. MEDCOBE isolates this effect by evaluating collaboration only on cases where the model has sufficient standalone knowledge, and then characterizes interaction behavior in terms of whether the model appropriately affirms correct clinician hypotheses and challenges incorrect ones. Across 20 LLMs, the proposed score is more strongly associated with held-out collaborative outcomes than standalone accuracy, and the resulting behavioral profiles are further used to guide prompt- and critic-based interventions.
Critical strengths
-
The paper identifies a meaningful evaluation gap. The “lost in collaboration” phenomenon is compelling: a model may answer a case correctly and consistently in isolation, yet still steer a clinician toward a worse decision during interaction. Conditioning the analysis on cases with sufficient standalone knowledge is a clean way to make this distinction.
-
The evaluation is unusually thorough for a benchmark-style paper. The authors test 20 models, separate the behavioral evaluation set from the held-out collaboration set, study several interaction contexts, validate the LLM judges against human annotations, and include additional statistical analyses showing that the MEDCOBE score contributes signal beyond standalone accuracy.
-
The behavioral profiles are easy to interpret. The distinction between sycophancy and obstruction is simple, but useful. Two models with similar overall collaboration scores can fail for very different reasons, and the paper makes a good case that these differences matter for mitigation.
Critical weaknesses
-
I am not fully convinced that the Affirm/Challenge abstraction is rich enough to characterize good clinical collaboration. The framework treats affirming a correct hypothesis and challenging an incorrect one as the desired behaviors. This is reasonable at a high level, but real clinical discussion is often less binary. A correct hypothesis may still deserve qualification, additional testing, or pushback on management; an incorrect hypothesis may still contain useful partial reasoning. Treating partial disagreement as Challenge may therefore blur together clinically helpful nuance and genuine obstruction.
-
The paper’s strongest deployment claims still rest on simulated clinicians. The simulator setup is useful for controlled experimentation, but it is still quite different from real clinical collaboration. The clinician is an LLM, the task is multiple choice, and both sides are given a fairly complete case representation. I think the results convincingly establish MEDCOBE as a pre-deployment sandbox, but they are weaker evidence that the same behavioral patterns will predict outcomes with practicing clinicians.
-
Cross-model comparisons of are not entirely apples-to-apples. The score is computed only on cases where each model achieves , which means different models are evaluated on different subsets of cases. For strong models these subsets are large, while for weaker models they can be much smaller and potentially easier or qualitatively different. The threshold analysis is useful, but it does not fully remove this case-mix issue.
-
The human validation is encouraging, but fairly narrow. The judge validation is based on 124 responses from ophthalmology cases annotated by a single senior ophthalmologist. The agreement numbers are reasonably strong, but the benchmark spans seven specialties. I would be more comfortable with the action and validity labels if this validation covered a broader set of specialties or involved multiple clinicians.
Questions for authors
See "Critical Weaknesses".
2 comments
Thank you for the careful response and for running the additional experiments during the discussion period. I have no further questions and will maintain my rating of 3.
To Reviewer VuZm
Thank you for your time and effort. We appreciate your kind words about our effort to make this paper thorough. We will do our best to improve our paper based on your comments.
[R1] Response to “Affirm and Challenge” (W1):
We agree that real clinical interaction involves more nuanced behaviors. We intentionally use a simplified formulation so we can quantify collaboration failures at scale without extensive annotation. Regardless, we believe a finer-grained behavior categorization can further improve MedCOBE’s effectiveness and is a promising next step.
Regarding your concern (“A correct hypothesis may still deserve..”), our post-hoc behavior judge also assesses behaviors’ validity with reference to the clinical scenario and expert-annotated explanations, rather than solely using the correctness of the clinician hypothesis to judge the appropriateness of partner actions.
[R2] Response to “predicting outcomes with practicing clinicians” (W2):
To investigate whether MedCOBE can predict outcomes with practicing clinicians, we’d need a large-scale clinician study, which we were not able to conduct.
As an alternative, we tried to make the simulation more realistic by incorporating diverse usage contexts (Table 2). We hereby present two additional experiments that further address task realism by (i) removing the decision options (i.e., open-ended diagnosis) and (ii) not providing the AI partner with the complete case information up front:
While these experiments still do not guarantee human-in-the-loop outcomes, we believe they further support MedCOBE’s robustness in diverse, real-world-like scenarios.
[R3] Response to “apples-to-apples case pool” (W3):
We appreciate your keen observation. As you pointed out in Strengths, we condition the analysis on K_x = 1.0 cases to disentangle interaction behavior from insufficient knowledge. However, not being “apples-to-apples” indeed may affect cross-model result interpretation.
We address this by calculating AI partners’ MedCOBE score using “all cases” in the evaluation set. We hereby report that AI partners’ ranking consistency between these results and the original MedCOBE score is: Kendall’s τ = 0.91, Spearman’s ρ = 0.98. The results show that AI partners’ relative rankings of MedCOBE scores generally align, regardless of whether they are “apples-to-apples” or not.
We also re-do the correlation analysis from Figure 3 (a) using this all-case MedCOBE score, and the results show that a knowledge-conditioned MedCOBE score correlates better with collaborative acc, supporting our designed knowledge-behavior disentanglement:
While we tried to include a “matched-K-is-1-case” experiment, too few cases have all LLMs uniformly reach K_X = 1.0 to support reliable calculation of the MedCOBE score and correlation analysis. Note that each 15-model-matched case is associated with a different combination of 15 LLMs:
[R4] Response to “human annotation” (W4):
We’d like to mention that the behaviors are labeled by referencing the doctor-annotated explanations in the dataset (line 245). Clinical appropriateness is thus mainly supported by ground truth rather than LLM knowledge.
We additionally recruited 3 specialists to annotate responses from other JAMA domains (60 responses per domain). We report their agreement (κ) with our 3-judge aggregated labels.
Human specialists’ agreement remains fairly high across these new domains. We will incorporate these additional results into the revised manuscript to provide broader evidence for the reliability of both action and validity labeling.
We hope these additional analyses address your concerns about the soundness and generalizability of our evaluation and further strengthen the evidence supporting MedCOBE as a pre-deployment diagnostic sandbox.