- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies online multiplier bootstrap inference for Polyak–Ruppert averaged stochastic approximation. The analysis covers fixed momentum with fixed preconditioning as well as dynamic preconditioning without momentum. The authors establish bootstrap validity under suitable regularity and stability conditions. For dynamic preconditioning, they also show that bootstrap replicas could share the original preconditioner sequence without changing the first-order inference. The proposed method is evaluated through regression simulations and an application to the Adult data.
Critical strengths
-
The paper extends online bootstrap inference to averaged stochastic approximation with fixed momentum or dynamic preconditioning. Their analysis also allows nonsmooth scores such as the quantile regression score.
-
The first-order equivalence between frozen and joint replicas is practically useful. Replicas could share the original preconditioner sequence, which reduces computation and storage.
Critical weaknesses
-
The bootstrap guarantees require mean-square convergence rates for the original and weighted recursions. These rates are not verified for the quantile and logistic regression applications, which might limit how the results could be applied to these settings.
-
The experiments provide limited evidence for practical inference. The momentum comparison uses the true parameter to select step sizes, and the dynamic preconditioning experiment uses the true response probabilities in its curvature update. The correlated Gaussian experiments indicate severe undercoverage. In addition, it remains unclear whether the proposed method provides reliable inference with feasible tuning and curvature estimation.
Questions for authors
-
In the dynamic preconditioning experiment, do frozen and joint replicas give similar coverage when the curvature update uses the current parameter estimates instead of the true response probabilities?
-
I wonder if there's a tuning rule that does not use the true parameter? If so, does it give reliable coverage in the correlated Gaussian settings of Table 1?
4 comments
Part 2/2 of our response to Reviewer SF6E (continued): W1 continued: fixed momentum and model verification; W2 and Q1–Q2.
For fixed normalized momentum, assume in addition a uniformly bounded score and bounded multipliers, a fixed symmetric positive-definite , deterministic finite initial states, and . With
\qquad z_t=\theta_t-\frac{\beta}{1-\beta}\eta_tPm_t,$$ the filter states are uniformly bounded and the exact transformed update is $$z_t=z_{t-1}-\eta_tP W_tG(\theta_{t-1},Z_t) +\frac{\beta}{1-\beta}(\eta_{t-1}-\eta_t)Pm_{t-1}.$$ Here $\\|\theta_{t-1}-z_{t-1}\\|=O(\eta_{t-1})$ and $\eta_{t-1}-\eta_t=O(\eta_t/t)$. Lipschitz continuity of $g$ therefore changes the conditional mean increment from $-\eta_tPg(z_{t-1})$ by $O(\eta_t^2)$. Since $\\|\nabla V(z)\\|\le aM(1+V(z))$, this perturbation and the Taylor remainder contribute at most $C\eta_t^2(1+V(z_{t-1}))$. Absorbing its $V$-dependent part into the negative drift gives $$\mathbb E[V(z_t)\mid\mathcal F_{t-1}] \le(1-c\eta_t)V(z_{t-1})+C\eta_t^2$$ eventually. The comparison argument in Part 1/2 yields $\mathbb E V(z_t)=O(\eta_t)$, and $\\|\theta_t-z_t\\|=O(\eta_t)$ gives the same mean-square rate for $\theta_t$. For logistic regression, assume a finite identified target with positive-definite population Hessian. Its convex loss has $\\|G(\theta;X,Y)\\|\le\\|X\\|$ and a globally Lipschitz mean gradient whenever $\mathbb E\\|X\\|^2 < \infty$. Bounded covariates and bounded nonnegative mean-one multipliers therefore verify the fixed-momentum conditions. Without momentum, bounded multipliers and an exponential moment of $\\|X\\|$ verify the envelope condition, including Gaussian covariates, for predictable preconditioners satisfying the two-sided spectral bounds in Part 1/2. For quantile regression, use bounded covariates, bounded nonnegative mean-one multipliers, conditions (i)–(iii) of the submitted Corollary C.5, and a uniform global upper bound on the conditional density. The quantile excess risk is convex, the score is bounded, and the global density bound makes its mean gradient Lipschitz. The positive-definite target Jacobian supplies the local radial drift. This verifies the fixed-momentum rate without projecting or changing the score. The inference result retains $\alpha(1+\nu) > 1$. These are sufficient path-rate results under additional assumptions. Curvature variation remains a separate requirement for dynamic-preconditioning inference, and the broader finite-moment corollaries remain conditional on separately verified path rates. **W2.** Feasible current-parameter curvature works favorably in the specified logistic cells, whereas this truth-free tuning criterion does not deliver reliable inference in the correlated Gaussian linear cells. **Q1.** We have evaluated curvature at the current primary parameter and, for Joint replicas, at each replica's current parameter. Parameter updates use the previous curvature states; Frozen replicas share the evolving primary curvature. On matched streams with $B=20$, feasible-curvature Frozen/Joint coverage is 0.940/0.948 at $n=10^4$ and 0.956/0.956 at $n=5\times10^4$, compared with oracle values 0.946/0.950 and 0.956/0.958. This gives similar marginal coverage in the tested diagonal positive-margin logistic cells. **Q2.** The original momentum pilot uses the true parameter and remains explicitly an oracle device. We have tested held-out squared prediction loss plus mean squared replica displacement on 80 independent training/holdout pairs, each stream of length $n$ ($160n$ additional observations per cell, shared across candidates). Selection is frozen before evaluating streams held out from that pilot; these validation seeds reuse the original Gaussian experiment. This paired diagnostic uses the stated additional pilot data. At $r=0.9$, dense contrast coverage across the three momentum values ranges from 0 to 0.006 for $n=2000$, and from 0.106 to 0.140 for $n=10000$; at $r=0.98$, all reported coverages are zero. Thank you again for your valuable feedback. We hope our responses address your concerns and welcome any further questions or discussion.Thank you again for your careful review and constructive feedback. We hope that our responses and revisions have addressed your concerns and questions. If you find that they resolve your main concerns, we would be grateful if you would reconsider your assessment and score in light of these changes. We would be happy to clarify any outstanding points.
Thank you for the response and additional experiments. The new rate arguments under the additional assumptions and the results using estimated curvature address part of my concerns. However, the tuning rule without the true parameter still gives poor coverage in the correlated Gaussian settings, so my concern about practical inference remains. I will maintain my rating of weak acceptance.
Thank you for your time and valuable comments.
Note: Because of the 5000-character limit, we divided our response into two comments.
W1. Condition (40) provides a sufficient global quadratic drift route. For the logistic and quantile examples, the following convex risk argument supplies an alternative primitive rate result.
Let F be the finite population excess loss, with F(θ⋆)=0, and let g=∇F. Assume that F is globally convex, g(θ⋆)=0, ∣g(θ)∣≤M, and g is globally L-Lipschitz. Assume also that, for some r,μ>0,
\qquad (\\|e\\|\le r).$$ A positive-definite derivative of $g$ at the target implies this local radial-drift condition. For the recursion without momentum, use deterministic finite initialization and $\eta_t=\eta_0t^{-\alpha}$ with $1/2 < \alpha < 1$. The preconditioner is predictable and symmetric, with deterministic bounds $$0 < p_- I\preceq P_t\preceq p_+ I < \infty.$$ Write $H_t=W_tG(\theta_{t-1},Z_t)$, where the fresh observation and multiplier are independent of the past, the multiplier is independent of the observation, and $\mathbb E W_t=1$. Assume $\mathbb E(H_t\mid\mathcal F_{t-1})=g(\theta_{t-1})$ and a state-uniform envelope $\\|H_t\\|\le J_t$, where the fresh envelopes have a common law satisfying $\mathbb E\exp(\lambda J_t) < \infty$ for some $\lambda > 0$. The original recursion uses $W_t\equiv1$. To verify the rate, put $s=\\|\theta-\theta_\star\\|$. Convexity along rays and the local drift give $$F(\theta)\ge \frac{\mu s^2}{2}\quad(s\le r), \qquad F(\theta)\ge \mu r s-\frac{\mu r^2}{2}\quad(s\ge r),$$ and $\\|g(\theta)\\|\ge\mu\min\\{s,r\\}$. Also $F(\theta)\le Ls^2/2$ locally. Consequently, for $V(\theta)=\exp\\{aF(\theta)\\}-1$ and any fixed sufficiently small $a > 0$, there are positive constants such that $$\\|\theta-\theta_\star\\|^2\le C V(\theta), \qquad \nabla V(\theta)^\top P_tg(\theta)\ge c_0V(\theta).$$ Indeed, near the target $\\|g\\|^2\ge 2\mu^2F/L$, and outside the radius-$r$ ball $\\|g\\|\ge\mu r$. These bounds imply $\\|g\\|^2\ge c(1-e^{-aF})$, which yields the second inequality. The bounded Lipschitz gradient gives the Taylor bound $$\lvert V(\theta+h)-V(\theta)-\nabla V(\theta)^\top h\rvert \le C(1+V(\theta))\\|h\\|^2e^{aM\\|h\\|}.$$ Choose $a$ so that $aMp_+\eta_0 < \lambda/2$. The envelope then bounds the conditional expected remainder for $h=-\eta_tP_tH_t$ by $C\eta_t^2(1+V(\theta_{t-1}))$, and ensures finite exponential Lyapunov moments at every finite time. Thus, for all sufficiently large $t$, $$\mathbb E[V(\theta_t)\mid\mathcal F_{t-1}] \le (1-c_0\eta_t+C\eta_t^2)V(\theta_{t-1})+C\eta_t^2 \le (1-c\eta_t)V(\theta_{t-1})+C\eta_t^2.$$ Taking expectations and using $\eta_{t-1}/\eta_t=1+O(t^{-1})=1+o(\eta_t)$ shows that $\mathbb E V(\theta_t)/\eta_t$ is bounded: its recurrence is eventually bounded above by $(1-c\eta_t/2)\mathbb E V(\theta_{t-1})/\eta_{t-1}+C\eta_t$. Therefore $$\mathbb E\\|\theta_t-\theta_\star\\|^2=O(\eta_t).$$ *Continued in Part 2/2: W1 continued: fixed momentum and model verification; W2 and Q1–Q2.*