- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper examines whether verbalized confidence predicts LLM correctness on clinical tabular tasks. It distinguishes outcome AUROC from correctness AUROC and proposes an external XGBoost calibrator using model outputs, attribution divergence from mutual information references, and task descriptors. Experiments across three model families, nine tasks, and three prompting conditions demonstrate substantial gains from target task adaptation alongside inconsistent transfer without adaptation.
Critical strengths
1.The paper illustrates a practically important distinction between clinical-outcome discrimination and the ability to identify incorrect predictions.
2.The evaluation covers multiple model families, clinical tasks, and prompting conditions, and includes informative analyses of negative transfer and source-versus-target-only training.
3.The proposed formulation is compatible with proprietary APIs, and the attribution-only results suggest potentially useful signals beyond verbalized confidence on difficult tasks.
Critical weaknesses
1.The supplied code constructs MI references from the full labeled target cohort before forming evaluation splits. Appendix G describes few-shot adaptation but implements within-task cross-validation. Support sets are also balanced using known prediction correctness. These choices undermine the claimed held-out evaluation and labeling efficiency.
2.Correctness AUROC measures ranking, not probability calibration, and no calibration or selective-risk evaluation substantiates the deployment claims. Table 3 contradicts the claim that confidence is fundamentally uninformative. The related-work discussion also mischaracterizes prior studies, including Xiong et al. (2024), that already evaluate correctness prediction.
3.The main adaptation protocol lacks matched output-only and logit-only baselines; within-task ablations do not establish attribution gains at the claimed label budget. Moreover, fixed JSON examples of 0.85 confidence and 0.75 self-assessment match Qwen’s dominant outputs, leaving prompt anchoring as an uncontrolled explanation for confidence collapse.
Questions for authors
1.Can you rerun the full pipeline with MI references estimated exclusively from the permitted support labels, a disjoint test set, and support acquisition that does not condition on unknown correctness? Please also reconcile Appendix G with the released implementation.
2.Under identical support sets and test patients, how does the full method compare with predictors using only the predicted label, confidence, and self-assessment, or only logits for Qwen? Please report paired uncertainty estimates, probability-calibration metrics, and risk–coverage performance.
3.Do the confidence-collapse findings persist after removing or varying the numerical examples in the output schemas? How would these controls affect the claim that verbalized confidence is fundamentally uninformative?
2 comments
Follow-up: corrected few-shot protocol in revised PDF
Dear Reviewer,
Thank you again for your careful review and for examining our code. We have posted our responses and uploaded a revised PDF along with the revised code, with changes marked in blue and summarized with section pointers in our general comment. Following the issues you identified, we corrected the few-shot protocol: support sets are now drawn at random, the mutual information reference is estimated from the support set only, and evaluation excludes the support patients. All few-shot results were rerun under this protocol with 5 support draws and confidence intervals (Sec. 5.4, App. I.2), alongside new baselines and calibration metrics. We would be grateful to know whether these changes address your concerns, and we are happy to clarify anything before the discussion period ends.
Corrected protocol (results hold), new baselines and calibration metrics added
We thank the reviewer for the detailed review and for examining the code. The issues identified were real, and we have corrected them.
W1 / Q1. MI references, Appendix G, and support selection.
The reviewer is correct on all three points. We reran the full pipeline so that, at each k, (i) MI reference is estimated only from the k labeled support patients, (ii) supports are drawn at random rather than stratified by correctness, and (iii) evaluation uses only the remaining, disjoint patients. Results are essentially unchanged, at k=200 (Gemini, zero-shot), improvements over verbalized confidence are +0.351 on AKI (previously +0.363), +0.304 on PE (+0.295) and +0.098 on IHM (+0.082). Under the same protocol, GPT-5.5 shows the same pattern (AKI +0.328, PE +0.138, IHM +0.077). MI rankings from random k subsets are mostly stable and give unchanged within-task calibrator AUROC. We agree Appendix G mixed a stability analysis with an adaptation experiment. At k=0 (LOTO), we state that the reference uses labeled target data, the revision separates them. The idea is to use disagreement of the model with a good reference which might give some insight into the model's confidence and correctness, this reference can be from a domain-expert or from the data (MI or weighted MI). The calibrator is aligned to the quality of the gold-standard reference.
W2. Calibration and selective-risk metrics.
We reported AUROC because the intended use is ranking predictions for review, where only ordering of scores matter. We agree these metrics are necessary and report both. At k=200, the calibrator reduces mean ECE from 0.126 (raw verbalized confidence) to 0.046 and mean Brier from 0.201 to 0.160, with the largest gains where confidence is least reliable (for PE: ECE 0.214 to 0.057; revisit: 0.272 to 0.076). On both tasks, deferring by raw confidence is worse than deferring at random (overall error 36.7% and 37.6%). On high-accuracy ED tasks where verbalized confidence is well calibrated (ICU transfer, ECE 0.024), the calibrator does not improve further. For selective prediction, mean AURC falls from 0.187 (raw confidence) to 0.142. At 80% coverage, the error rate drops from 38.5% to 25.9% on PE and from 39.2% to 25.6% on AKI. For GPT-5.5, mean ECE falls from 0.095 to 0.040 and AURC from 0.186 to 0.148; on AKI, error at 80% coverage drops from 38.1% to 24.8%. Paired bootstrap CIs will be in the revision.
W2. Contradiction with Table 3 and related work.
We agree that our claims were too strong about all models. Table 3 supports it for Qwen, (3 distinct confidence values, self-knowledge AUROC 0.50 on most tasks). Gemini and GPT-5.5 are moderately informative (mean 0.659, 0.699) but unreliable under a single threshold. We now describe confidence as a weak and inconsistent correctness signal. Our work is complementary to Xiong et al. (2024), they report text Q&A outcomes and model’s correctness, we do it for tabular datasets and compare how the Ask can diverge from Aclf, benchmarking these numbers and analyzing the gaps, we do not claim that self-knowledge metric as a contribution. Further, they use multiple inferences for a single testcase, whereas our method only needs two calls at most which is much more scalable, we do this by taking advantage of the tabular structure of the data.
W3 / Q2. Matched output-only and logit-only baselines.
We now report these under the adaptation protocol itself, with identical supports and evaluations. At k=200, the full calibrator for Gemini exceeds the output-only model (ŷ, c, p_true) on all 9 tasks (mean AUROC 0.758 vs. 0.668). For Qwen, we add logit-only and output-plus-logit baselines. At k=200, the full calibrator exceeds the output-plus-logit model on 7 of 9 tasks (mean AUROC gain +0.101; PE +0.285, AKI +0.169) and the logit-only model on 8 of 9 (+0.081). At k<=10, logits alone transfer better; attribution features become beneficial from k = 50. We agree our baseline of choosing raw confidence served the purpose of comparing the model's raw confidence which did not test the method. Our new results show gains over outputs-only models, which establish the need for these external features along with model-output features. It is worth noting that, combination of both types of features is what that performs well not each alone.
W3 / Q3. Prompt anchoring.
The example values in our schema (0.85, 0.75) match Qwen's dominant outputs. Consistent with prior findings, verbalized confidence often depends on prompt template instead of task-difficulty or answer correctness which is again a failure mode. The same schema was used for Gemini and GPT-5.5, which produce a wider range of values (Table 4,5,6), suggesting the collapse reflects Qwen’s susceptibility to anchoring rather than the schema alone. We agree this means Qwen’s verbalized confidence reflects the prompt more than its own confidence.