Parameter-Efficient Is Not Function-Stable: Function Trust for Model Adaptation
Abstract
Parameter efficiency constrains where a model changes, but not how far its predictive function moves. We introduce \trust, a parameterization-agnostic framework that adapts a model subject to a user-specified budget on the forward KL divergence from a frozen source predictor over cached source inputs. A primal–dual Powell–Hestenes–Rockafellar augmented Lagrangian approximately solves the constrained problem, while the budget formulation remains independent of the solver. Conditional on achieving the replay constraint within tolerance , we bound population functional drift by and source-risk change by , where captures replay-to-population generalization; a margin corollary controls deterministic prediction changes. Across TinyBERT and Qwen3-0.6B, \trust consistently reduces source forgetting and held-out KL for LoRA, full fine-tuning, and our structured adapter, with small or parameterization-dependent changes in target quality. Yet equal replay budgets need not imply equal held-out behavior: increasing TinyBERT replay from to examples reduces validation KL from to , while low-margin replay at fixed reduces it from to . Fixed-penalty and augmented-Lagrangian frontiers overlap; our contribution is therefore not solver dominance. The evidence instead shows that functional stability is not a by-product of parameter efficiency: it must be explicitly budgeted, measured, and audited.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.