- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper studies whether the location Fisher information matrix of the joint observational distribution suffices to recover the causal order. It constructs two nonlinear models with identical matrices but incompatible orders, and derives an exact gradient-covariance expression for the discrepancy between Schur elimination and true marginalization. It also evaluates Score-Schur Topological Sort, which estimates the matrix once and recursively applies Schur updates. Validation includes algebraic checks, synthetic benchmark comparisons, paired matrix diagnostics, and the Sachs dataset, showing successful recovery in some synthetic settings but limited accuracy and inconsistent overall efficiency gains elsewhere.
Critical strengths
-
A clear counterexample. This establishes a precise distinction between identifying a leaf and recovering a complete order, ruling out universal recovery by any ordering rule based solely on this matrix even with perfect estimation.
-
An interpretable characterization of elimination error. The exact gradient-covariance identity identifies what a Schur update omits when removing a true leaf and explains why the discrepancy vanishes for linear mechanisms. This provides a useful analytical basis for understanding the limits of extending linear precision-based elimination to nonlinear models.
Critical weaknesses
- Limited significance of the theoretical contribution. The paper does not sufficiently establish why restricting causal discovery to a single joint expected score-Jacobian matrix is an important practical problem, particularly when existing methods already avoid retraining while retaining sample-level score access. The counterexample establishes a specific information limitation, but the covariance identity is a short consequence of standard score decompositions, and the recovery conditions do not yield an informative nonlinear recoverable class or characterize partially identifiable structure. Together, these results provide insufficient theoretical advancement to support acceptance.
- The experiments establish neither a compelling practical benefit nor a convincing explanation of failure. The main public comparison covers a narrow synthetic family, with weaker ordering accuracy than established baselines at larger scales and no consistent end-to-end runtime advantage in the matched comparison. The experiments also do not isolate whether the gradient-covariance term explains the observed sorting errors, and the proposed sufficient condition does not explain successful leaf selections in the reported diagnostics. These limitations leave the paper without sufficiently strong empirical evidence of either practical utility or mechanistic insight to support acceptance.
Questions for authors
- What concrete practical benefit does restricting access to the fixed joint SJIM provide over methods that already avoid retraining?
- What evidence distinguishes sorting errors caused by the gradient-covariance gap from those caused by score estimation error?