- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper asks which of two variables is the cause and which is the effect when the effect may have been transformed in an unknown nonlinear way. It studies how the effect's percentiles shift as the possible cause changes, relative to the spacing between those percentiles. This quantity remains the same after a smooth, increasing transformation of the effect. The authors prove that a simple pattern in this quantity can often identify the causal direction, then turn the idea into several practical scores.
Critical strengths
-
The transformation-resistant quantity is an interesting way to connect several familiar causal models in one framework. The paper also gives a formal argument for why the causal direction can often be identified under its assumptions.
-
The authors report both successes and failures. On simulated data, their more robust general score reaches 93.2% accuracy, close to a strong comparator's 95.0% (Table 3/ Panel A), while their simpler score runs much faster.
Critical weaknesses
-
The two general scores perform poorly on the broader benchmark collection. In Table 4, they reach 50.8% and 54.8% average accuracy across 19 cause-effect benchmark groups, the lowest two results among seven methods. The best comparator reaches 69.1%. The faster score is close to chance, while the more accurate score takes about 2.8 seconds per pair. The strong simulation results therefore do not yet show a practical advantage across varied data. The authors should explain which kinds of data cause these failures and how a user could recognize them in advance.
-
The theorem does not say how much evidence a finite dataset needs to distinguish the two directions. It says the wrong direction generally has a different pattern, but that difference can be very small. In some simulations, the simpler score chooses the correct direction only 0-4% of the time despite the theoretical distinction. The paper links this to small differences and estimation errors. An analysis of the size of the difference, even in a restricted case, would better connect the theorem to the method used in practice.
Questions for authors
- Which benchmark groups account for the low Table 4 averages, and can a user tell when either general score is likely to work?
- In the settings where the simpler score gets only 0-4% correct, how small is the difference between directions? Would changing the assumed number of shared patterns improve the result?
2 comments
Follow-up on our rebuttal
Dear Reviewer vbQT,
Thank you again for your review. Could you let us know whether our revision and rebuttal have addressed your concerns and whether you would consider updating your assessment? We are happy to clarify any remaining concerns.
Rebuttal
Thank you for the constructive review. References follow the revised manuscript.
W1 and Q1. Benchmark performance and recognizing failures
All four class-specific scores are now evaluated without class selection. QG-LSNM reaches 69.6% at 0.014 s per pair, comparable to the strongest baselines (68.3–69.1%, 0.047–2.6 s). For LSNMs, its generic identifiability follows from Theorem 1 through Proposition 2.
Table 11 identifies where the FRDR scores fail. Equal-group averages are:
The FRDR deficits are concentrated in seven groups simulated from other model families and in the in-silico DREAM4 networks.
Xi et al. (2025) [1] designed Per/Sig/Vex so that existing model classes are misspecified, and the QPE-generated groups use prescribed-basis QPE models [2].
We have not determined whether these groups have finite-rank drift ratios; estimation error can also cause failures within the model class, as discussed below.
Recognizing failures. Appendix F.6.3 tests abstention using the normalized score gap c. For QG-LSNM, benchmark accuracy rises from 69.6% to 71.2% at the primary threshold c≥0.05 (90.6% of pairs decided) and to 76.5% at c≥0.20 (67.2% decided).
For QG-FRDR-W, c≥0.05 improves accuracy on the five linear-location LSNMs from 79.8% to 85.4%, retaining 82.6% of pairs.
The gap does not detect the FRDR reversals on Per/Sig/Vex: their more confident decisions are less accurate.
Section 8.3 therefore recommends QG-LSNM for an unknown class; reliable failure detection for the FRDR scores remains open.
W2 and Q2. Population gaps and rank
Gap size. Appendix F.7 (original Table 14, now Table 19) computes population scores numerically on a 50×50 grid.
For the five failing mechanisms with Gaussian cause and noise, the causal rank-two score is zero and the reverse scores are 0.0007–0.0088: less than 1% of squared norm lies outside the reverse rank-two approximation.
Separately, the noise-balanced experiments at n=1000 give mean estimated scores of 0.026–0.033 causally and 0.014–0.018 in reverse. This wrong ordering is consistent with direction-dependent estimation error and the observed 0–4% accuracy.
Changing rank. On the transformed versions of these mechanisms, K=2,3,4 gives QG-FRDR accuracies of 1.6%, 1.4%, and 1.0%, and QG-FRDR-W accuracies of 79.8%, 70.4%, and 66.0% (Table 13). Increasing K therefore does not resolve these failures.
Once K covers the causal rank, increasing it can only reduce the reverse population rank score; K=1 instead favors the reverse direction for all five mechanisms (Table 19).
Analysis of gap size. We do not have a theoretical analysis on the size of the directional gap. To our knowledge, the closest methods (CVEL, QPE, LRQS) also share this limitation, which is an important direction for future work.
[1] Xi et al., Distinguishing Cause from Effect with Causal Velocity Models, ICML 2025.
[2] Chen et al., Causal discovery via quantile partial effect, ICLR 2026.