- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper aims to recover recurring regimes and changing causal relations from a multivariate time series with unknown boundaries. It proposes SEAM, which learns a separate causal graph for each regime while sharing unchanged structural equations. A description-length score and a resampling procedure distinguish no change, changes in noise levels, and changes in mechanisms. Theoretical analysis and experiments examine change detection, graph recovery, and intervention effects, with an application to seasonal river dynamics.
Critical strengths
- The method addresses the useful distinction between changing causal directions and changing noise levels. The analysis also identifies a concrete failure of sharing equations without accounting for sign changes.
- The experiments include several regime-aware baselines, different innovation distributions, and informative ablations. The supplementary results openly report cases where the proposed method loses accuracy or another method performs better.
Critical weaknesses
-- The error guarantees do not cover the full claim of distinguishing mechanism changes from noise changes. The implemented resampling procedure generates data from a single fitted regime, whereas unchanged mechanisms can still produce different distributions when their noise levels change. The theoretical null result concerns a stationary Gaussian process, and the finite-sample guarantee applies to a different procedure without temporal dependence. The variance-change experiment is useful, but it examines a restricted setting in which only one root variable changes its noise level. Consequently, the reliability of mechanism attribution under more general noise changes remains uncertain, despite the low false-report rate on stationary series.
-- The paper does not establish when its reported causal directions and intervention effects are uniquely determined. The theory shows when a mechanism change can be distinguished from a scale change, but this does not establish that the selected graph is the only causal explanation of the observations. The paper acknowledges observational equivalence, yet reports individual graphs and effects without indicating which conclusions remain ambiguous. This matters in the river application: the stage measurements are closely related, and the documented reversal disappears when the Astoria series is removed. Although this sensitivity is reported transparently, agreement with the seasonal pattern alone does not establish the reliability of the inferred direction.
-- The reversal experiments provide limited evidence beyond a particularly favorable graph structure. Most of the main comparisons use the same reversal pattern, with additional variables that help distinguish the regimes and orient the focal relations. Increasing the system size retains this pattern within a shared background graph. The experiments on other methods' benchmarks broaden the evaluation, but the dense-graph results also show substantially poorer graph recovery than CASTOR. The current evidence therefore leaves unclear how much of the reported advantage depends on the distinguishing variables in the chosen reversal design, especially when their influence is weak or most equations change.
-- The benefit of sharing is not fully established when the regimes must also be learned. The sharing ablation supplies the true regime labels, and the efficiency result assumes the correct labels and structural description. These results support improved estimation once the groups are known. However, sharing also influences the score used to learn those groups, so incorrect assignments can change which equations are pooled. The existing comparison does not determine whether sharing improves the complete procedure or propagates segmentation errors. This distinction is particularly relevant because weaker changes already cause missed regimes and poorer localization.
Questions for authors
See weaknesses.
Thanks for the responses. My score remains the same.