acceptodds
Under review as a conference paper at ICLR 2027

Think Until No Future Thought Can Help: Certified Remaining-Gain Stopping for Adaptive-Compute Policies

Abstract

Adaptive-compute policies commonly stop on confidence or latent convergence rather than the decision consequence of further computation. We introduce , which certifies the remaining gain: the largest improvement in a fixed reference utility that any uncomputed future prefix could provide over the current action. A normalized split-conformal score gives simultaneous coverage across depths under exchangeability, supporting adaptive stopping and post-calibration tolerance choice. We derive stopping-risk, expected-gain, oracle-depth, critic-error, shift and performance-difference guarantees, and distinguish population occupancy calibration from empirical recalibration. At matched violation rates on six graph tasks, requires recurrent steps versus for the best heuristic gate calibrated by Learn-Then-Test. Across eight planning tasks and forty training runs, removes of recurrent steps at simultaneous coverage. On all five MinAtar games, the policy is trained by -learning for M frames with five seeds, using its own frozen critic as reference. Held-out coverage averages , with fewer recurrent steps and of full-compute return. Equivalence holds within (); a confidence gate at the same risk target requires the depth for indistinguishable return. CPU speedups range from to , and a scalar remaining-gain head matches the structured lattice at lower cost. Empirical occupancy recalibration restores near-nominal held-out coverage on average after adaptive deployment shifts the state distribution.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.