acceptodds
Under review as a conference paper at ICLR 2027

Functional Ambiguity Reduction: Minimax Acquisition under Observational Equivalence

Abstract

Finite observations can leave distinct latent populations observationally indistinguishable while those populations imply different values of a target functional. We study how this target-relevant ambiguity limits recovery and how it should guide subsequent acquisition. We first characterize recoverability under a finite response design: the largest functional ambiguity is exactly twice the best uniform approximation error of the target by the observed response coordinates, and this approximation error equals the minimax recovery error of any estimator based only on the observed response vector. This characterization yields Functional Ambiguity Reduction (FAR), which selects queries according to the target disagreement that can remain among observationally compatible populations. FAR is one-step minimax-optimal for worst-case absolute target recovery under exact responses and extends to finite response batches and learned response models. Across five public datasets, FAR shows its clearest gains on CIFAR-10H and Duolingo-FR, reducing MAE on Duolingo-FR from \(0.1330\) for the strongest baseline to \(0.1263\). We further apply FAR to budgeted LLM evaluation, where five additional queries reduce score-estimation MAE by on Qwen3-4B and on Phi-3.5-mini relative to the strongest baseline for each model. These results connect finite-design identifiability directly to adaptive acquisition for population-level functional recovery. Code is available at https://anonymous.4open.science/r/FAR-D5B5/.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.