acceptodds
Desk rejected at ICLR 2027

The Statistical Value of Resolution in Heavy-Tailed Dependent Residual Fields

Desk rejected at ICLR 2027, so left out of the paper lists and the map.

Abstract

Structured predictors often return a residual field with many coordinates per observation, but higher resolution need not provide proportionally more statistical evidence. We ask a basic question: under heavy tails and structured dependence, when does an additional residual coordinate actually reduce uncertainty? For a valid dependency graph on the residual field and a finite centered -th moment, , we derive a profile-aware evidence count that controls generalized Catoni risk estimation. Fractional independent-set covers give a graph-level refinement that can increase the evidence count, subject to support-size and confidence costs, while constant-probability lower bounds on canonical coordinate and space–time block families show that the dependence penalty is unavoidable up to logarithmic factors. We expose the graph assumption through safe supergraphs, independent-pilot transfer, conservative complete-graph fallbacks, and approximate-independence extensions. Experiments support the predicted finite- scaling trend, show severe undercoverage when the dependence/color factor is undercounted, and reveal a average uncertainty inflation on bounded CIFAR-10 residual maps. Decision audits further show that the value of dependence information is target-specific: it can change uncertainty dramatically without changing point rankings, and frozen dependence-aware risk-control rules can still abstain at small sample sizes. The resulting framework separates observed resolution from decision-relevant evidence.

Primary area:
learning theory
Keywords:
Heavy-Tailed Learning, Structured Dependence, Effective Sample Size, Robust Risk Estimation

Related papers

Discussion (0)

Sign in to comment.