- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the problem of identifying independent subspaces within linear non-Gaussian models. The core approach involves identifying all projection directions that satisfy independence conditions by examining the null space of a specific linear operator; based on this, the authors develop the GIN test and a method for estimating the dimension (TIN). The paper provides theoretical results and validates the proposed methods using both simulated and real-world data.
Critical strengths
-
Characterizing all independent directions via the null space—rather than searching for them one by one—is an intriguing approach. The identification results, derived under finite-feature assumptions, also enhance the practical utility of this method.
-
The testing procedure accounts for errors introduced during the estimation of projection directions, which is a noteworthy detail. The experiments also include useful ablation analyses.
Critical weaknesses
I have concerns regarding the choice of baselines in the multidimensional GIN experiments. The proposed method utilizes the entire null space of the covariance operator, whereas HSIC and LiNGIC are applied using only a single direction. This discrepancy may exaggerate the relative performance of the proposed method. While ablation studies are provided, they do not fully clarify the specific source of the observed performance gains.
Questions for authors
-
If HSIC and LiNGIC were applied using the same directional space—while controlling for the Type I error rate—to what extent would the proposed method still demonstrate an advantage?
-
In Appendix G, only 499 bootstrap iterations are performed, resulting in a minimum p-value of 0.002. Given this, how should the clustering results on the real-world data be interpreted when using a significance level of ? Furthermore, would the conclusions change if the number of bootstrap iterations were increased?
3 comments
Thank you for the detailed response and additional experiments. I have no further questions.
Thank you for taking the time to review our response and the additional experiments. We are glad we could address your questions.
We thank the reviewer for careful reading and suggesting these comparisons.
W1&Q1: We added three baselines based on the estimated covariance-null space. Let Y=(Y1,…,Yd) denote the projections of X onto a basis of that space.
All the tests used the same variance-normalized basis fitted to the test data and 499 draws per method. Our bootstrap refitted the basis in each paired resample. The baselines used random-sign multipliers with a first-order correction for basis estimation, holding rank and bandwidths fixed. FS-HSIC tested Y against the full vector Z. RP-HSIC shared signs across 50 projections to calibrate the maximum standardized HSIC. FS-LiNGIC corrected both the Gaussian and quadratic kernel terms in Y and shared signs across Zj to calibrate Fisher’s combination of rank-based p-values. For each method and condition, we used 999 null datasets to select a cutoff targeting a 5% Type I error rate. We then evaluated all methods on the same 1,000 held-out null datasets and 500 alternative datasets. Each entry reports power at θ=0.8, with the held-out Type I error rate in parentheses. Both are percentages averaged over the five source distributions.
In Setting II, our test exceeded the strongest baseline, FS-LiNGIC, by 37.94 percentage points in mean power (75.05% vs. 37.11%), with held-out Type I error rates of 5.16% and 4.94%, respectively. In Setting III, the gain over the strongest baseline, RP-HSIC, was 45.70 percentage points (81.21% vs. 35.51%), with corresponding Type I error rates of 5.04% and 5.20%.
Q2: Thank you for raising this point. The clustering search retains a pair of indicators when it passes the rank checks and its GIN test does not reject. At α=0.001, all three pairs in the speed group and all three in the error group passed the rank checks. All six GIN queries had nonempty candidate spaces, so with 499 bootstrap draws their smallest attainable p-value was 0.002. Our procedure therefore retained all six pairs and recovered both groups (F1=0.80). Using Fisher-combined p-values, the HSIC baseline rejected two of the three error-group queries and the LiNGIC baseline rejected all three. Both recovered only the speed group (F1=0.50). The higher clustering F1 reflects recovery of the additional reference group and cannot by itself establish greater GIN rejection power.
We then increased the budget to 49,999 paired-bootstrap draws per query, lowering the minimum attainable p-value to 0.00002 and allowing rejection at α=0.001. All 20 bootstrap runs on the same dataset again recovered both groups (F1=0.80).