Sharp Limits and Efficient Recovery of Latent Memberships in Random-Design Regression
Abstract
Mixed regression models capture population heterogeneity through distinct regression relationships across latent groups. When group memberships are scientifically or practically meaningful, recovering them becomes a fundamental inferential problem. Yet the statistical limits of membership recovery remain much less understood than those of estimating the regression components. For the two-component Gaussian random-design model with , we show that the minimax mis-clustering risk is of order for noise-to-signal ratio , while exact recovery is possible if and only if . These limits arise from an intrinsic ambiguity induced by the random regression margin, whose mass near zero determines the mis-clustering scale, while the minimum realized margin across the sample governs exact recovery. We further develop an efficient procedure attaining both limits, in which a bounded-residual spectral direction is combined with the pooled residual to form an initial partition, followed by hard least-squares iterations that geometrically contract a margin-weighted Hamming loss.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.