acceptodds
Under review as a conference paper at ICLR 2027

TamedMALA: Critically Scaled Score Taming for Robust Langevin Sampling

Abstract

The Metropolis-adjusted Langevin algorithm (MALA) can be highly efficient when the score provides a reliable local proposal direction, but excessively large scores can instead produce proposals that are almost always rejected. We introduce a proposal-scale-coupled family of score tamers, combined with an exact Metropolis–Hastings correction. For fixed-dimensional product blocks, we derive the leading Hastings expansion and show a scaling transition governed by the coupling exponent : for , taming worsens the proposal-variance scaling, whereas for the classical MALA scaling is preserved. At the critical coupling , we obtain an explicit nonnegative asymptotic efficiency penalty on regular targets, clarifying that taming should act as a robustness safeguard rather than improve well-behaved MALA. We further show that uniquely balances saturated deterministic drift with proposal noise. The resulting coordinate-wise TamedMALA achieves essentially MALA-level stationary efficiency across six independent tune-and-evaluate repetitions, while maintaining reliable recovery from deliberately pathological score states where MALA exhibits rejection-induced sticking. A short-chain tuner selects the additional taming scale automatically with stable stationary performance.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.