acceptodds
Under review as a conference paper at ICLR 2027

Confidence Is Not Enough: Decision-Value Finding Selection Beats Confidence-Gated Test-Time Compute

Abstract

Test-time compute methods decide how much extra computation to spend by reading the model's own confidence. We show that signal is invalid exactly when the model lacks the information it needs to answer: on interactive MedQA-USMLE the confidence–correctness correlation is near zero under minimal information and becomes predictive only as the record is read. 16 self-consistency at low information buys nothing (, ) while revealing two findings gains (), even beating a gold-aware compute allocator (, ). We make finding selection first-class and control it by the classical decision value of information: the finding most likely to flip the model's greedy answer. The criterion is training-free, gold-free, and survives miscalibration because a flip is a behavioral event. The prevailing selection criterion, greedy entropy reduction (the literature's “EIG”), is empirically indistinguishable from confidence gain and inherits the same pathology. Decision-value and entropy-reduction coincide under calibration and diverge under insufficiency, at two layers—selection and stopping—with which layer pays off set by how the belief is miscalibrated: selection wins under rank miscalibration (–), stopping under level miscalibration, where the continuous signal saturates (– of states ) but the binary flip transfers (– across Qwen2.5 scales, / on reasoning models, at matched reading budget). One decision-value currency arbitrating read/compute/stop Pareto-dominates the deployed controller (, ) and clears the entire pure-reading frontier, beating its best point by at less budget. Scope: four-way multiple-choice reading over an available record, against a self-consistency compute baseline; we do not evaluate acquisition of genuinely unobserved outcomes, nor compute controllers built on verifiers, process rewards, or search.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.