- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3(+1)
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper compares Bayesian ridge and split-conformal prediction intervals built around the same NGRC predictor. For fixed-dimensional settings, it derives limiting interval widths based on the residual root-mean-square scale and an absolute-residual quantile. In high-dimensional settings, it separates the effects of ridge bias, estimation variance, and posterior uncertainty, and establishes an explicit condition for comparing interval widths under an isotropic Gaussian model.
Critical strengths
- The analysis of fitted quadratic prediction errors is a key strength of the paper. Lemma 5 uses the quadratic component of the prediction error to establish a Gaussian approximation. Corollary 3 then bounds the contribution of training noise and identifies a remaining condition on the ridge-transformed bias.
- The comparison of prediction intervals accounts for different sources of uncertainty. Using the same fitted predictor makes the comparison easier to interpret. The finite-sample analysis separates ridge bias, estimation variance, and posterior uncertainty, and the proofs establish concentration of the realized prediction error before deriving the conformal interval widths.
Critical weaknesses
-
The paper needs to clarify what it adds beyond existing work on ridge regression and quadratic features. Theorem 1 relies on consistency results for residual scales and quantiles, while the threshold in Corollary 2 is consistent with the established prior matching and optimal ridge scale, as the authors acknowledge in Section 4.4 and Appendix C.7.4. A relevant reference is Pandit, Wang, and Zhu, JMLR 2025. Their Lemma 21 establishes a similar order of quadratic-form concentration for the centered quadratic block considered in Lemma 4, and their paper also studies regression-risk limits in the quadratic scaling. The main contribution beyond this existing work therefore appears to be the analysis of the fitted-residual distribution and its use in deriving conformal quantiles. A more direct comparison with this paper would help clarify the novelty and significance of the contribution.
-
The connection between the main theoretical result and nonlinear forecasting applications is not fully established. The quadratic-feature theorem relies on several specific assumptions, including population-normalized features built from Gaussian base vectors, fixed regularization, an exact readout, and Gaussian noise. The deterministic extension also requires a condition involving the unknown signal and the fitted ridge matrix. Proposition 1 extends the results to sufficiently separated windows, but at a substantial sampling cost, and it retains the assumptions on the marginal model and readout. Meanwhile, the real data experiments use settings that do not fully satisfy the theorem's assumptions and serve mainly as qualitative illustrations. Although the authors clearly acknowledge these limitations, the paper would be stronger if it included a concrete forecasting model covered by the quadratic analysis or provided a clearer justification for how the theory relates to the applications.
Questions for authors
-
The paper would benefit from a clearer explanation of what Theorem 3 or Corollary 3 adds beyond existing work on quadratic feature concentration and ridge regression risk, particularly Pandit, Wang, and Zhu (JMLR 2025). Which part of the fitted-residual or quantile analysis provides the main new technical contribution?
-
What class of nonlinear forecasting processes is the quadratic benchmark, and its extension to dependent time windows, intended to capture? How do the Gaussian-base and exact-readout assumptions relate to this class?
-
Does the current analysis cover a specific class of nonzero deterministic quadratic signals for which Equation (5) can be verified after ridge fitting? Please clarify which cases are already covered by the existing proofs and which would require further analysis.
4 comments
Response 2 of 3: W2/Q2: forecasting model class
W2 / Q2 — Which nonlinear forecasting processes the quadratic benchmark captures, and how the Gaussian-base and exact-readout assumptions relate to them.
We will make the model class explicit in the revision. Call it the Gaussian-linear-state quadratic Volterra (GLQV) model: a stationary Gaussian linear process (an ARMA process, or the discretized linear memory dynamics of Appendix B), observed through a delay vector with covariance , and a response with independent Gaussian noise. After population whitening , the NGRC feature vector is up to a fixed linear map, and the readout is exact with determined by . This is the discrete-time second-order Volterra expansion of a Gaussian-driven linear memory system, i.e. the second-order truncation of the memory-driven class in the introduction. In this class, “Gaussian base” means Gaussian innovations of the linear state and “exact readout” means that the second-order truncation is exact. Random readouts correspond to the random-effects version of Theorem 3. Fixed dynamical systems correspond to deterministic readouts, for which Corollary 3 additionally requires Equation . The temporal experiment in Appendix E.3.2 is an instance with an state and diffuse . Its results are collected with the overlap diagnostics in our response to Reviewer qR69, W1/Q1. The Gaussian-input experiment in our response to Reviewer qR69, W1/Q1 provides an exact-readout example of this class and reports the existing temporal diagnostic alongside the new overlap sweep. That response also contains the autonomous nonlinear forecast, which tests departures from the Gaussian-base and exact-readout assumptions. For the nonlinear Volterra experiment with data-selected regularization, see Reviewer BwAY, Q1. For the theoretical coverage discussion under dependence, see Reviewer qR69, W1/Q1, which cites Oliveira et al. under their stated conditions.
Response 3 of 3: Q3: deterministic signals and diagnostics
Q3 — Which deterministic quadratic signals satisfy equation (5) after ridge fitting.
The following cases are currently covered. (a) Theorem 3 covers random-effects readouts under its stated assumptions. (b) Corollary 3 covers deterministic readouts for which Equation holds. Its proof already controls the noise-induced part of the quadratic direction at order . The remaining condition concerns the deterministic bias after ridge fitting. Raw diffuseness alone does not establish this condition. The diagnostics below evaluate the transformed direction for specific fixed signal families. If needed, we can include an explicit sufficient class of deterministic quadratic signals satisfying Equation in the revision. To diagnose the transformed-signal condition directly, we held coefficient directions fixed across independent training-design/noise repetitions at each dimension. In the pure-quadratic diagnostic, the linear coefficient block is zero and the quadratic coefficient vector has squared norm . Features are independent population-normalized Gaussian linear-plus-quadratic rows with , and . Table R13. Fixed-strength, purely quadratic deterministic-readout diagnostic.
| Base dimension | Transformed quadratic norm | Residual Gaussian KS distance | Mean SCP width | Finite-trace width |
|---|---|---|---|---|
Norm and KS entries are means Monte Carlo standard errors. Widths are replication means. From to , the transformed operator norm falls from to and the Gaussian KS distance from to . The difference between mean SCP width and its finite-trace prediction falls from about to . At , SCP coverage is . The frozen full-feature, diffuse-diagonal, and concentrated controls have squared coefficient norm and remain fixed across repetitions. The table shows the smallest and largest tested dimensions. Diffuse directions show improving Gaussian approximation, while the concentrated control retains larger transformed norms and KS distances. These diagnostics support the fitted-residual mechanism for the tested signal families. They do not establish a general sufficient-class theorem. Table R14. Ridge-transformed diffuseness and residual Gaussian approximation at the smallest and largest dimensions.
| Base dimension | Signal | Transformed quadratic operator norm | Residual Gaussian KS distance |
|---|---|---|---|
| Frozen spherical | |||
| Diffuse diagonal | |||
| Concentrated | |||
| Frozen spherical | |||
| Diffuse diagonal | |||
| Concentrated |
We will place the necessary distributional diagnostics and model-class clarifications in the main manuscript within the conference page limit, with expanded numerical controls in the appendix. Thank you for your time and consideration!
References.
- R. I. Oliveira, P. Orenstein, T. Ramos, and J. V. Romano. Split Conformal Prediction and Non-Exchangeable Data. Journal of Machine Learning Research, 25(225):1–38, 2024.
- P. Pandit, Z. Wang, and Y. Zhu. Universality of Kernel Random Matrices and Kernel Regression in the Quadratic Regime. Journal of Machine Learning Research, 26(224):1–73, 2025.
Response 1 of 3: W1/Q1: contribution beyond PWZ
We thank the reviewer for a careful reading, for identifying the fitted-residual analysis as the core technical contribution, and in particular for the pointer to Pandit, Wang and Zhu (JMLR 2025), which we had missed and now cite and discuss.
W1 / Q1 — What Theorem 3 and Corollary 3 add beyond Pandit, Wang and Zhu (PWZ).
The reviewer is right that there is overlap. (i) Lemma 4, which establishes quadratic-form concentration for the centered quadratic block, is of the same order as PWZ’s Lemma 21. Our proof is a short Gaussian–Poincaré argument with explicit constants. We will state this and credit their result in the revision. (ii) When Σp=Ip, the conformal residual variance Tn in Theorem 3 is the random-teacher ridge risk in the quadratic regime n≍d2, which PWZ characterize. In the revision, we will present this agreement as a consistency check rather than as a contribution. (iii) As the reviewer notes, Theorem 1 is a consistency-type statement and the original known-noise Corollary 2 threshold coincides with prior matching and the optimal ridge scale. The revised contribution list separates “new” from “benchmark consistent with known results”. What PWZ do not give, and what we believe is new, is the object that the conformal interval depends on. A risk limit is a second moment. The split-conformal radius is a quantile of the fitted residual distribution. The two coincide only when that distribution is Gaussian, and Appendix C.6.5 shows that this can fail at the same risk. A residual concentrated on one quadratic direction has a centered χ12 law whose 0.95 absolute quantile is not z times its scale. The new technical pieces are as follows. (a) Lemma 5 provides a Stein-method Kolmogorov bound for a linear-plus-quadratic Gaussian functional whose rate is governed by the operator norm of the quadratic coefficient matrix. (b) Corollary 3, eq. 5, identifies the ridge-transformed direction Qd(λΣp1/2Aw0) as the relevant matrix rather than the raw signal Qd(w0). The counterexample shows why raw diffuseness is not enough. (c) The Dvoretzky–Kiefer–Wolfowitz step converts the conditional Gaussian approximation into the conformal quantile expansion with its m−1/2 term. (d) The concentration of r∗⊤Ar∗ for a dependent-coordinate test feature provides the control needed for the Bayesian width. Corollary 3 states a sufficient condition on the ridge-transformed quadratic direction for deterministic readouts. Under the assumptions of Corollary 3, suppose that the ridge-transformed quadratic direction satisfies ∣Dn∣op=OP(ρn) with ρn→0. For m independent calibration observations, the fitted-residual analysis gives q1−α=z1−α/2σ2+Bn+Vn+OP!(n−1/4+ρn+m−1/2). This identifies the additional distributional step needed to turn a prediction-risk calculation into a conformal-width comparison. The approximation is expressed using finite-sample trace quantities. Its error rate is distinct from the rate at which those trace quantities converge to their spectral limits.