- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents an algorithm for causal structure learning applicable to causal structures in which all dependencies between observable variables are caused by latent parents.
Critical strengths
The strength of the paper is that it relies on a simple statistic (Eq 8) to infer common influences.
Critical weaknesses
The main limitation is that the novelty is limited and it is unjustified why not further statistics that can play a similar role are combined (questions 8-10).
Questions for authors
1-While cumulant tensors are described in Section 2.2, the results of Section 4 are not fully linked to cumulant properties, namely to the multilinear factorization of tensors: for , , with , independent, . This property underlies the form of Eq 8 and 9 and clarifies the scope of the Triplet Difference approach: Once the linear latent causal model is adopted, no new set of cumulant properties needs to be derived. The novelty lies in the identification of the specific cancelation of Eq 8 and 9 for certain latent causal structures, and hence its utility for structure learning. Clearly separating standard cumulant properties from the novelty in their use would sharpen the scope of the contribution.
2-Related to the above, the proofs in Appendix A are very unnecessarily convoluted. They just apply the multilinear factorization, but the fact that the factorizing factors that cancel are not identified with auxiliary variables makes the formulas long and less transparent. Eq 12 to Eq 17 derive from a common principle that can be express in a more concise and transparent form.
3-Related to the above, the lack of additional transparency in the proof of Th 5.1 renders less visible an additional concern: lines 695-696 state, but do not prove, the desire case in which . In fact, the cancellation may still occur, but it would require some fine tuning of the mechanisms and hence of the coefficients and statistical properties. The statement would need to be punctuated by some assumption of stability to infinitesimal changes (faithfulness-like assumption), if a full proof without such an additional assumption cannot be fully shown.
4- In Figure 1, should be ; should be .
5- After eq 7, should be .
6- Eq 5 is not consistent with the notation of Eq 3. You write and . For consistency with Eq 3 you will need to write instead of .
7-The novelty of the paper is not well circumscribed: the criteria of Eq 9 and 10 are not new, they are a concrete instantiation of a standard well-known cumulants property. The core of the Latent Causal structure learning Algorithm 2 is not new either, it is shared and preceded by several previous works in causal learning with latent parents. It goes back to Silva et al 2006, and is substantially analogous to Cai et al. 2019. The novelty is hence the implementation of the TD algebraic invariant as a cheap statistic to apply the Latent Causal structure learning Algorithm.
8-It is not justified why all the focus is on the statistic of Eq 9. There are alternatives to exploit the same sort of causal structure of Fig 1. For example, consider , , $C(X_2,X_3^2) = b_{2,1} a_{2,1}^2 b_{3,2}^2 ,K_3(L_1)$. Therefore, Fig 1 leads to . So this $\tau_2(i,j|k) \equiv C(X_1^2,X_2)C(X_2,X_3^2) - C(X_1,X_2,X_3)^2 $ could have been used. But this is only one additional case. You also have, for , that , for different . Or you have , and . So the corresponding differences work as signatures of the same causal structure as well.
9-Note that in fact of Eq 9 could equally be used simply as . This would have the advantage of avoiding numerical instabilities when or are close to zero. On the other hand, for any of the statistics or the ones described in point 8 above, which have a form , the actual test can be performed on , being a very small constant. This would render the estimation of the difference proportional to their magnitude, but would avoid the product in the denominator.
10-The authors may argue that all these alternatives are valid, but that they prove that the use of Eq 9 is enough for completeness. However, two lines of arguments can be raised against that claim. First, the issue raised in point 3 above. Since some assumption of faithfulness is required, the combination of several statistics could be helpful to unmask cases in which a zero value is not associated with the causal structure, but a consequence of some parameter tuning. Second, and in practice perhaps more importantly, even with total faithfulness, in the regime of estimation from finite data, it is expected that performance could potentially improve substantially if not relying on a single statistic.
11-It would have been more general to present in Section 4 the general derivation using conditional cumulants, that is, terms like , where are observable latent ancestors that inactivate paths such that the same procedure described in the paper is only applicable after conditioning on them. Nothing qualitatively changes, but the formulation is more general.
12- The restriction of no direct connections between observed nodes is quite restrictive. This is tested in Case 5, but this is only a single fixed scenario. It would have been more informative to present simulations with progressively stronger direct connections, or progressively more existing direct connections, and quantify the degradation of the latent structure recovery performance.
11 comments
Response to Reviewer 68vc (2/9) — Proof revision and complementary constraints
Q2 — Reviewer comment
Related to the above, the proofs in Appendix A are very unnecessarily convoluted. They just apply the multilinear factorization, but the fact that the factorizing factors that cancel are not identified with auxiliary variables makes the formulas long and less transparent. Eq 12 to Eq 17 derive from a common principle that can be express in a more concise and transparent form.
Response to Q2
The proof in the original version adopted term-by-term expansion to explicitly demonstrate how observed variables within the same causal cluster share latent contributions and how the causal coefficients of distinct latent variables cancel out in the constructed statistic. Beyond merely presenting the multilinear decomposition of cumulants, we intended to help readers directly grasp why variables from the same cluster yield identical statistics given the same auxiliary variable, thereby satisfying the zero-TD equality constraint. This step is central to connecting cumulant properties with causal cluster identification.
Following your suggestion, we have revised the proof in the manuscript. We retain the representative derivation for the same-cluster case, explicitly factor out the causal coefficient to illustrate its cancellation, and adopt unified notation to streamline redundant calculations for other cases. This revision preserves the intended link between structural assumptions and equality constraints in the original proof, while making the shared principle behind Equations (12)–(17) much clearer.
Q3 — Reviewer comment
Related to the above, the lack of additional transparency in the proof of Th 5.1 renders less visible an additional concern: lines 695-696 state, but do not prove, the desire case in which . In fact, the cancellation may still occur, but it would require some fine tuning of the mechanisms and hence of the coefficients and statistical properties. The statement would need to be punctuated by some assumption of stability to infinitesimal changes (faithfulness-like assumption), if a full proof without such an additional assumption cannot be fully shown.
Response to Q3
We thank the reviewer for identifying a gap in the original proof. We agree that comparing the contributions of a single noise source leaves open the possibility of parameter cancellation in an individual TD constraint. The proof can be completed by using two auxiliary pure indicators and complementary cumulant configurations.
Suppose the two pure indicators under consideration belong to distinct latent variables and . Since each latent variable has at least two pure indicators, we can choose one additional pure indicator of each latent variable as an auxiliary variable. Let
For and , define
where the bracketed superscript denotes the number of times a variable appears as an argument of the cumulant.
We use the additional pure indicator of as the auxiliary variable for configuration and the additional pure indicator of for the complementary configuration . If the loadings and the th-order marginal cumulants of both latent variables are nonzero, then simultaneous vanishing of the two cross-product constraints yields, after canceling the loading factors,
In the latent structural model, independent disturbances with strictly positive variances ensure that the latent covariance matrix is positive definite. Hence
The linear system therefore has only the solution . Under the nondegeneracy condition , at least one of the two constraints must be nonzero and thus distinguish the indicators as belonging to different clusters. This argument allows parameter cancellation in an individual TD constraint.
For third-order cumulants, is self-complementary, and the existing procedure already evaluates both required constraints by checking all auxiliary variables. For fourth-order cumulants, the guarantee applies to the joint use of configurations and . The third-order result does not provide a guarantee for either fourth-order configuration on its own.
We will state these identification conditions explicitly in the main text and provide the details of the loading cancellation and the proof for general cumulant orders in the appendix. We will also update the higher-order implementation to follow the revised criterion and re-evaluate the experimental results affected by this change.
Response to Reviewer 68vc (3/9) — Notation corrections and relation to prior work
Q4 — Reviewer comment
In Figure 1, should be ; should be .
Response to Q4
We appreciate the reviewer for pointing out the labeling issue in Figure 1. We have corrected the corresponding symbols and cross-checked the annotations in the diagram, structural equations and main text to ensure consistent mapping between variable indices and causal edges.
Q5 — Reviewer comment
After Eq. 7, should be .
Response to Q5
You are correct, and we have fixed this issue in the revised manuscript.
Q6 — Reviewer comment
Eq. 5 is not consistent with the notation of Eq. 3. You write and . For consistency with Eq. 3 you will need to write instead of .
Response to Q6
We align Equation (5) with Equation (3) and standardize notations for repeated cumulant arguments in the revised manuscript.
Q7 — Reviewer comment
The novelty of the paper is not well circumscribed: the criteria of Eq. 9 and 10 are not new, they are a concrete instantiation of a standard well-known cumulants property. The core of the Latent Causal structure learning Algorithm 2 is not new either, it is shared and preceded by several previous works in causal learning with latent parents. It goes back to Silva et al. 2006, and is substantially analogous to Cai et al. 2019. The novelty is hence the implementation of the TD algebraic invariant as a cheap statistic to apply the Latent Causal structure learning Algorithm.
Response to Q7
We agree that the multilinear expansion of cumulants is a standard result and that the two-stage framework of first recovering measurement clusters and then inferring causal relationships among latent variables has precedents.
Our contribution is to establish an explicit algebraic correspondence between TD constraints on joint cumulants of observed variables and the underlying latent causal structure. By combining cross-cumulants of different orders, the TD constraints cancel terms arising from the effects of shared latent causes on the observed variables. The constraints serve different purposes in the two stages. To recover measurement clusters, we examine which TD constraints vanish for a pair of observed variables across multiple auxiliary variables. Under the stated nondegeneracy conditions, this pattern distinguishes indicators in the same cluster from indicators in different clusters. To infer the causal ordering of the latent variables, we use the observed variables in one cluster as references and infer the ordering from how the pattern of cross-cluster constraints changes with the choice of reference cluster.
The Triad criterion of Cai et al. (2019) obtains structural information by testing whether a pseudo-residual is independent of an auxiliary variable. TCD directly evaluates TD constraints on cross-cumulants of observed variables and specifies the conditions under which satisfaction of these constraints supports causal structure identification. This gives both cluster recovery and latent causal ordering a common algebraic criterion, removing the need to construct pseudo-residuals and perform independence tests at each stage. We have revised the manuscript to explain how the TD equalities are constructed, what structural distinctions they capture, and under what conditions those distinctions are identifiable.
Response to Reviewer 68vc (1/9) — Contribution and cumulant factorization
Thank you for your detailed review and constructive suggestions. We respond to your comments below.
W1 — Reviewer comment
Response to W1
We appreciate this critical comment. The core contribution of this work lies in constructing the TD constraints from an algebraic perspective to eliminate the effects of latent variables. We further leverage the constraint patterns across different observed triplets to identify latent causal clusters and recover the causal order over latent variables. This yields a unified algebraic criterion for both tasks without relying on independence tests. We emphasize that our novelty is not merely the computational form of this statistic itself. More importantly, our contribution establishes the mapping between these observable algebraic constraints and the target latent causal structures, together with a systematic structural recovery framework built upon this mapping.
For this reason, we deliberately focus on TD in isolation in the current theoretical development: combining additional statistics would entangle these carefully constructed algebraic constraints and break the clean cancellation mechanism that removes effects of latent variables, making it much harder to establish the identifiability guarantees for cluster grouping and causal ordering. We agree that integrating complementary statistics is a promising avenue for improving robustness, which we have discussed as future work in the revised manuscript.
We provide our responses to each question point by point.
Q1 — Reviewer comment
Response to Q1
Your understanding of the contributions of Equations (8) and (9) in this paper is correct. The key finding of this work is that specific latent variable structures induce equality relations among the cross-cumulants of observed variables, which can be exploited for structure identification. By constructing Equations (8) and (9), we eliminate the shared influence of the same latent variable on observed variables, such that the latent relationships that are not directly observable can be characterized via constraints among observable statistics. Furthermore, we leverage the satisfaction patterns of these constraints across different triples to identify causal clusters and infer the causal order among latent variables.
Therefore, the contributions of this paper lie in the construction of these concrete algebraic constraints and the establishment of the connection between such constraints and latent variable structures. The multilinear decomposition property of cumulants serves as the theoretical foundation for this construction. Nevertheless, this decomposition alone does not directly yield the TD constraints and the corresponding structural identification criteria proposed in our work.