acceptodds
Under review as a conference paper at ICLR 2027

THE MODULARITY TRAP IN PRIVATE INFERENCE

Abstract

Orthogonal scores remove the first-order effect of nuisance estimation; differential privacy adds a second operation, bounding the contribution of each record. We show that where the bound is placed matters: clipping the completed orthogonal score can change the nuisance rates required for inference, even when the clip keeps the null mean exactly zero. No bounded nonlinear scalar map escapes the effect, since preserving every centered nuisance tangent forces affinity. An exact residual-product construction makes the consequence sharp. With nuisance errors of order for , the inherited zero-centered test on the clipped product rejects the null with probability tending to one, while the Prediction-Bounded Orthogonal Score (PBOS), bounding a centered residual multiplier instead of the product, keeps size under the same rates and admits finite-sample calibration with a lattice release. The rate gap resurfaces as a threshold gap once each method is recalibrated, and the threshold gap as a power gap: in text-representation audits under strong confounding, both placements retain nearly identical standardized signal, yet PBOS attains power against for product clipping.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.