- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes KREDIT, a conditional independence test based on kernel-residualized distances. The method estimates conditional feature means using an independent training sample, residualizes distance-induced features on both sides, and constructs an off-diagonal, jointly studentized pair statistic. The theoretical analysis studies both null calibration and power in growing-dimensional settings. In particular, the paper separates sampling variation from errors introduced by conditional-mean estimation, establishes feasible Gaussian limits and finite-sample approximation bounds, and derives explicit dimension-dependent rates in several structured models. It also provides signal-relative power guarantees for shrinking alternatives and an information-theoretic lower bound in a Gaussian subexperiment.
Critical strengths
(1) The theoretical analysis is well motivated by the characteristics of the high-dimensional setting. The paper explicitly considers how spectral behavior, nuisance estimation, and signal strength change with dimension, and derives corresponding null calibration and dimension-dependent rates in several concrete regimes.
(2) The treatment of nuisance-estimation error is relatively refined. The analysis separates mean shift, directional first-projection error, and second-order pair-kernel perturbation. Compared with prior CME-based error analyses, this appears to provide a finer characterization of how conditional-mean estimation affects the test statistic. I did not identify any substantive theoretical issues in the derivations or main results.
Critical weaknesses
(1) The theoretical positioning of the paper is somewhat unclear to me. Most of the analysis is developed for the specific KREDIT statistic and for several structured model families, while parts of the perturbation framework appear substantially more general and may extend to other residual-covariance tests discussed in Table 1. At the same time, the empirical claims emphasize the practical advantage of the particular KREDIT construction. I think the paper would benefit from a clearer separation between what is genuinely specific to KREDIT and what should be viewed as a more general high-dimensional inference principle.
(2) The empirical evidence for the claimed power advantage is somewhat narrow relative to the breadth of the methodological claims. The main comparison considers only the two structured alternatives in Eq. (16), where KREDIT achieves very large power gains over all baselines. However, the paper provides limited analysis of why these particular alternatives lead to such strong power, or how they relate to the signal-relative conditions underlying the power-one result in Theorem 2. I think the paper should more explicitly characterize the regimes in which KREDIT is expected to be particularly powerful, and also provide boundary or counterexample settings where its global residual-covariance signal becomes weak or vanishes. Since the paper itself notes that this target can cancel across conditioning values, such cases would help clarify the actual scope and limitations of the proposed test.
Questions for authors
(1) Would it be possible to clarify which parts of the theoretical analysis are specific to the KREDIT statistic and which may extend to related residual-covariance tests such as GHCM or GKCM? I understand that a complete extension may be technically difficult, but even some discussion of this distinction would help clarify the scope of the theoretical contribution.
(2) Could the authors provide more intuition for the particularly large power gains in Eq. (16), and discuss settings in which this advantage is expected to weaken?