- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies whether a prespecified response coordinate contributes to the discrepancy between two multivariate conditional distributions at a fixed covariate profile. The localized null hypothesis requires preservation of the target coordinate’s conditional marginal distribution and its marginal-standardized cross-association with the remaining responses. The proposed test statistic is closely related to the conditional MMD studied in Yan et al. (2022). A multiplier bootstrap is used to approximate the critical value, and the authors establish asymptotic validity under the null and consistency under fixed alternatives.
Critical strengths
- Rather than only testing whether two conditional distributions differ, the paper investigates which response coordinates contribute to the discrepancy at a particular covariate profile. The hypothesis concerns not only the conditional marginal distribution, but also its marginal-standardized cross-association with the remaining responses.
- The paper establishes the asymptotic validity and consistency of the proposed test method.
Critical weaknesses
- The main distinction from existing localized conditional two-sample testing is the inclusion of a marginal-standardized dependence component in the null hypothesis. While this extension is mathematically well motivated, its practical importance is not fully established.
- Assumption 4.4 requires the conditional distribution estimator to converge in total variation sufficiently fast for the quadratic remainder to be asymptotically negligible.
- The theoretical framework assumes fixed covariate and response dimensions.
- When multiple covariate profiles or response coordinates are examined simultaneously, no multiple-testing correction is applied.
Questions for authors
- The paper would benefit from clearer justification of when dependence-only coordinate contributions are scientifically meaningful. Moreover, Regarding localized conditional distribution testing component, what is the main methodological distinction between the proposed approach and Yan et al. (2022)?
- Does the conditional distribution estimator used in the paper satisfy Assumption 4.4? How sensitive is the proposed test to the estimation error?
- What is the computational cost of the proposed testing procedure? How should the bandwidth be selected in practice? How is it chosen in the experiments?
- If the goal is to identify a set of contributing coordinates or covariate profiles, how should multiplicity be handled?
- The theoretical analysis focuses on fixed alternatives. It would be useful to provide a local alternative analysis to characterize the detection boundary or asymptotic power. Yan et al. (2022) imposes restrictions relating the kernel smoothness order to the covariate dimension. Why are analogous restrictions not required here?
- Section 5.2 compares LTCC only with Marginal Local-CMMD. It would strengthen the empirical evaluation to include competing methods in the other simulation and application settings as well.
4 comments
Response to Reviewer crvd (Part 2/4)
W2. Convergence Conditions for First-Stage Estimation in Total Variation
We clarify the role of the high-level condition on the conditional-distribution estimator and provide finite-sample sensitivity evidence. Assumption 4.4 requires the cross-fitted conditional-distribution estimators to have error in total variation at ; Assumption 4.5(iii) adds . Together, these conditions control the quadratic remainder in Theorem 3.1 and, with cross-fitting and the remaining conditions in Assumption 4.5, the perturbation of the estimated influence functions in the expansion and bootstrap. The detailed double-kernel construction, regularity conditions, and convergence-rate calculation showing attainability are given in our response to Reviewer UCJ7, W2. Figure 6 provides complementary finite-sample evidence for the estimators used in the experiments.
Q2. Sensitivity to First-Stage Estimation Error
Figure 6 complements Assumption 4.4 with a finite-sample sensitivity study. Under the coordinate null hypothesis, LTCC has empirical rejection rates close to the nominal significance level with the oracle and flexible estimators, whereas the misspecified linear-Gaussian estimator leads to size distortion. Under the shape alternatives, the flexible estimators retain increasing empirical power. The detailed rate argument and KDE attainability example are given in our response to Reviewer UCJ7, W2; Figure 6 reports the estimator-sensitivity results in Appendix D.4.
W3. Fixed-Dimensional Theoretical Scope
We thank the reviewer for pointing out this scope limitation. Our theoretical framework establishes pointwise inference for fixed covariate and response dimensions and under Assumptions 4.1–4.5. Extending LTCC to diverging covariate or response dimensions is important, especially for high-dimensional applications, and would require additional control of the conditional-distribution estimation error, localization, and influence-function terms. We consider this a natural direction for future research. The concluding discussion also clarifies the scope of our current theoretical results and notes the potential extension to diverging dimensions.
Q3. Computational Cost and Bandwidth Selection
We thank the reviewer for asking about computational cost and bandwidth selection. In the revised version, we have added a detailed computational-complexity analysis to Appendix D.4.
For one prespecified response coordinate and covariate profile , let denote the total sample size, the number of conditional Monte Carlo draws, and the number of multiplier-bootstrap repetitions. Let denote the estimator-dependent cost of fitting the first-stage conditional distributions and generating the corresponding Monte Carlo draws.
For the Gaussian-kernel implementation, the main computational cost arises from constructing the influence-function Gram matrix. Direct pairwise evaluation gives a conservative upper bound of . Once constructed, the Gram matrix is reused across bootstrap repetitions, each requiring operations. The fitted conditional distributions and Monte Carlo draws are also reused across bootstrap repetitions.
Under the fixed-dimensional assumption (Assumption 4.1), the overall computational complexity therefore simplifies to
For practical bandwidth selection, we use a sample-size-dependent bandwidth of order , which satisfies the stated fixed-dimensional bandwidth conditions for the dimensions and kernel order considered. The specific bandwidth choices for the synthetic experiments and ImageNet-9 application are detailed in Appendices D.1 and D.5, respectively. Appendix D.4 further examines sensitivity to the localization and association-kernel bandwidths, with empirical size and power reported in Figure 7.
Response to Reviewer crvd (Part 3/4)
W4/Q4. Multiple Testing Across Coordinates and Simultaneous Inference Across Profiles
We thank the reviewer for raising this issue. Our framework establishes pointwise inference for a prespecified coordinate and profile . Multiple coordinates and profiles lead to two inferential problems:
(1) Multiple testing across response coordinates.
For a fixed profile , the family consists of the coordinate null hypotheses. Bonferroni and Holm adjustments can be directly applied to the pointwise p-values to control the family-wise error rate (FWER), without requiring independence among the tests. The Benjamini–Hochberg (BH) procedure can provide false discovery rate (FDR) control under suitable dependence conditions, such as independence or positive regression dependence on a subset (PRDS). However, the dependence among LTCC coordinate-wise p-values is nontrivial because the tests share observations and involve overlapping association components. Therefore, the standard BH guarantee cannot be directly invoked without further characterizing this dependence structure.
(2) Simultaneous inference across a finite set of covariate profiles.
In the revised version, we have established simultaneous inference across a finite set of covariate profiles and provided the corresponding theoretical guarantees in Appendix H.
For a fixed response coordinate consider a prespecified finite collection of distinct covariate profiles , with fixed . Define the joint null hypothesis
Under Assumptions 4.1–4.5 imposed at each profile, with the first-stage total-variation convergence condition holding jointly over this finite collection, the existing influence-function expansion extends to the product Hilbert space . In particular, writing , , we obtain where is a joint Gaussian random element with covariance operator . This block-diagonal structure follows from the compact support of the localization kernel and : the local neighborhoods of distinct fixed profiles eventually do not overlap, so their leading influence-function terms have asymptotically zero cross-covariances.
We can then construct a joint multiplier bootstrap by generating observation-level Gaussian multipliers independently within each population and reusing the same multiplier for each observation across all profiles. Specifically, for each , we compute the bootstrap process using the existing construction in Section 4.2, replacing by . Denoting the resulting joint process by , the corresponding joint bootstrap consistency result is
Based on this result, define the maximum bootstrap statistic , and let be its conditional -quantile. Under the corresponding nondegeneracy and continuity conditions, we obtain Consequently, simultaneous inference across the prespecified profiles can be conducted using the common critical value: The resulting max-bootstrap procedure provides asymptotic type I error control at level for the joint null hypothesis .
Response to Reviewer crvd (Part 4/4)
Q5. Local Alternatives and Kernel-Order Conditions
We thank the reviewer for this helpful suggestion.
(1) Local alternatives.
In the revised version, we have included new theoretical results in Appendix I on the asymptotic properties of our proposed test under the following local alternatives.
Let $ a_n^2=(n_1h_1^d)^{-1}+(n_2h_2^d)^{-1}. $ Consider a local alternative sequence $ \gamma_{j,n}(x_0) $ satisfying
\qquad \Delta_j\in\mathcal H_j.$$ This formulation covers local changes in the conditional marginal distribution, the marginal-standardized cross-association, or both. In Appendix I, we establish uniform versions of the asymptotic linear representation and show that $$a_n^{-1}\widehat\gamma_{j,n}(x_0) \Rightarrow \mathbb G_{j,0}(x_0)+\Delta_j,$$ where $\mathbb G_{j,0}(x_0)$ is Gaussian with mean zero and covariance $V_{j,0}(x_0)$. Hence $$a_n^{-2}\widehat Q_{j,n}(x_0)\Rightarrow\left||\mathbb G_{j,0}(x_0)+\Delta_j\right||_{\mathcal H_j}^{2}.$$ The bootstrap critical value converges to the corresponding null quantile $c^{(0)}_{j,1-\alpha}(x_0)$, and the local asymptotic power is $$\beta_j(\Delta_j)=\mathbb{P}\left\\{\left\||\mathbb{G}_{j,0}(x\\_0)+\Delta_j\right\||_{\mathcal{H}_j}^{2}>c^{(0)}_{j,1-\alpha}(x_0)\right\\}.$$ More generally, write $\Delta_{j,n}:=a_n^{-1}\gamma_{j,n}(x_0)$. The resulting asymptotic power regimes are: - If $\Delta_{j,n}\to0$, equivalently $\|\gamma_{j,n}(x_0)\|=o(a_n)$, the asymptotic power converges to $\alpha$. - If $\Delta_{j,n}\to\Delta_j\neq0$, as in the local-alternative formulation above, the asymptotic power converges to the non-trivial value $\beta_j(\Delta_j)$ defined above. - If $\|\Delta_{j,n}\|\to\infty$, equivalently $\|\gamma_{j,n}(x_0)\|/a_n\to\infty$, then, provided the estimation error remains uniformly $O_p(a_n)$ and the bootstrap critical values remain bounded in probability, the asymptotic power converges to one. Thus, $a_n$ is the local detection scale for the RKHS contrast, while $a_n^2$ is the corresponding scale for $Q_j(x_0)$. **(2) Kernel-order conditions.** Yan et al. (2022) require $\nu>d/2$ for their global statistic, whereas their local procedure has no such additional restriction. LTCC assumes a bounded, compactly supported localization kernel of order $\nu\ge2$. Assumption 4.3 requires $\nu$-times continuous differentiability with bounded derivatives for the covariate density and for the conditional-distribution map in total variation. Assumption 4.5(ii) imposes \$ n_\ell^{1/2}h_\ell^{\nu+d/2}\to0 \$ together with stable local effective sample sizes. These conditions control the pointwise smoothing bias and variance; hence no separate $\nu>d/2$ condition is required for LTCC’s local procedure. ### Q6. Targeted Baseline Comparisons In addition to the comparison with Marginal Local-CMMD in Section 5.2, we also compare LTCC with Zipper-LOCO in Appendix D.2. Section 5.2 shows that LTCC detects dependence-only contributions when conditional marginal distributions are unchanged, whereas Marginal Local-CMMD remains close to its nominal significance level. Appendix D.2 shows that LTCC continues to identify a distributionally contributing coordinate as redundancy increases, whereas Zipper-LOCO's empirical power decreases as incremental predictive importance diminishes. If any additional baseline methods are considered relevant for comparison, we would greatly appreciate the suggestions and would be happy to include them in additional simulations. --- We thank the reviewer again for the constructive suggestions, which helped us clarify the practical interpretation of LTCC and its relation to existing methods.
Response to Reviewer crvd (Part 1/4)
We appreciate the reviewer’s constructive comments and helpful suggestions. We address each point below.
W1/Q1. Practical Importance and Scientific Interpretation of Dependence-Only Contributions
We appreciate the request to clarify the scientific relevance of dependence-only changes. They are meaningful when the object of interest is a system of responses rather than individual marginal distributions: for example, a fault can preserve the marginal distributions of several sensor measurements while changing their dependence structure, and the association pattern can then identify which measurements participate in the altered system behavior.
For example, in precision medicine, the two populations may represent treatment groups or disease states, with age, sex, and routine clinical measurements as covariates and biomarkers, omics features, or imaging measurements as the multivariate response. Identifying which measurements contribute to the between-group conditional distributional discrepancy can help characterize clinically relevant heterogeneity and guide further investigation. In credit-risk analysis, the populations may represent defaulters and nondefaulters, with age and credit limit as covariates and repayment delays, account balances, and payment histories as the response vector. Identifying contributing behavioral measurements among comparable customers can help characterize patterns associated with default risk. In both settings, a response coordinate may have an unchanged conditional marginal distribution while its marginal-standardized cross-association with the remaining responses changes. We have also added a discussion of the practical relevance of dependence-only contributions to the Introduction of the revised manuscript.
LTCC addresses this problem through three methodological contributions. First, we formulate a localized no-contribution hypothesis that characterizes whether a prespecified response coordinate contributes to a conditional joint-distribution discrepancy through its conditional marginal distribution or its marginal-standardized cross-association. Second, we introduce population-specific conditional PITs to remove coordinatewise marginal effects before comparing cross-associations, preventing marginal changes in non-target coordinates from being incorrectly attributed to the target coordinate. Third, we establish an equivalent direct-sum RKHS characterization and develop a cross-fitted one-step estimator with influence-function correction, together with asymptotic theory and multiplier-bootstrap calibration under the stated assumptions.
Section 5.2 isolates this setting: every coordinate has the same N(0,1) conditional marginal distribution in both populations, while the dependence between Y1 and Y−1 changes. LTCC has increasing empirical power as the dependence difference grows, whereas Marginal Local-CMMD remains close to its nominal significance level. The formal PIT-based construction and Gaussian illustrations are given in our response to Reviewer HCnF, Q1; here the point is the scientific interpretation of the resulting coordinate contribution. The ImageNet-9 application then illustrates the same coordinate-localization target in structured model outputs.
Q1. LTCC versus Yan et al. (2022)
We appreciate the comparison with Yan et al. (2022). Although both methods use localized conditional distribution testing, LTCC differs in three aspects:
Different inferential targets. Yan et al. (2022) test whether conditional response distributions differ at a given covariate profile. LTCC further identifies whether a prespecified coordinate contributes through its conditional marginal distribution or its marginal-standardized cross-association. Applying Yan et al.'s procedure separately to scalar coordinates can miss dependence-only contributions.
Marginal-standardized cross-association. We introduce a new coordinate-level measure based on population-specific conditional PITs. By transforming all response coordinates to uniform marginal distributions, this construction prevents marginal changes in non-target coordinates from being incorrectly attributed to association changes involving the target coordinate.
Inferential construction. We derive an RKHS-valued von Mises expansion and develop a cross-fitted one-step estimator with influence-function correction and multiplier-bootstrap inference. This differs from the conditional U-statistic and pooled local bootstrap used in our scalar Local-CMMD implementation.