Risk Controlled Safe Stopping for Sequential Data Acquisition
Abstract
In clinical diagnosis and tomographic imaging, data arrive one measurement at a time and each measurement costs time, money, or patient burden. Deciding *when* enough has been acquired is as consequential as deciding what to acquire, yet existing acquisition policies and heuristic stopping rules offer no guarantee on the risk of the decision made when acquisition halts. We introduce RCS, a post-hoc, distribution-free procedure that selects a stopping rule so that a user-specified risk, such as the false negative or false positive rate, is controlled among the samples on which the system commits to a decision. RCS treats each candidate rule as a trajectory-level selective predictor and certifies it with the Learn-Then-Test framework, giving a finite-sample guarantee on the risk *conditional on stopping*. Importantly, RCS can be applied over any acquisition pipeline without retraining, whether it is fixed, random, or learned. Because the controlled risk is absolute rather than relative to full acquisition, no rule is safe by construction; when none meets the target, RCS certifies that fact and defers to full acquisition instead of returning an unsafe rule. On a synthetic CIFAR-10 benchmark, on *FastMRI* knee k-space acquisition, and on an internal prostate *mri* cohort, RCS holds the target risk at every acquisition rate while stopping a substantial fraction of samples early, and it certifies a learned reinforcement-learning acquisition policy as a post-hoc wrapper.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.