acceptodds
Under review as a conference paper at ICLR 2027

PCDM: Shared Structure and Local Modulation for Dynamic Causal Discovery

Abstract

Two common approaches to dynamic causal discovery model nonstationarity as smooth temporal variation or latent regime switching. One absorbs changes in mechanisms into smooth drift, blurring abrupt regime shifts into gradual variation when regimes are short. Another introduces latent states with regime-specific edges and mechanisms, allowing ordinary fluctuations to harden into pseudo-mechanisms exactly where evidence is weakest. We therefore propose the Piecewise Causal Dynamic Model (PCDM). PCDM couples state-specific effective graphs through shared candidate scores and sparse local gates. Finite-sample analysis of a restricted regression analogue characterizes conditions for sharing benefits. Shared scores alone do not ensure that local gates select useful parents. We introduce observation-informed gate restart (INFO): a posterior-weighted additive fit ranks candidate inputs, and the resulting order reassigns existing gate strengths before neural learning resumes. On calibrated additive and core–private interaction mechanisms, INFO improves state-specific edge localization and lowers finite-response error relative to matched continuation and random-reassignment controls. Matched screening controls support the value of observation-specific state information for parent selection on additive mechanisms. Additional structured-state diagnostics show that state-inference bottlenecks can be substantially reduced, while the added benefit of sharing for private-edge localization remains to be established.

Primary area:
causal reasoning
Keywords:
Dynamic causal discovery, nonstationary time series, shared causal structure, sparse local modulation, latent-state inference

Reviews

Among:
Shape:
1234this paper, Bottom 9%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.50 over 2 reviews, above 9% of the others.
Reviewer_4KvQOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
1
Soundness
2(+1)
Read review
Paper summary

I focus on paper strengths, weaknesses, and contributions in later review fields, as appropriate. My assessment of the paper is it currently stands, overall, is as follows: the paper is a 9-page guide to a 36-page appendix. While technically, appendices are unlimited, the paper should stand on its own; the current version of this paper does not. I am completely unable to read the paper without referring to appendices constantly. Some concepts are not even introduced in the paper. For example, S0-S2, the three spline reference configurations,or M0-M2 labels used in the structure tables, appear in the appendix only. I don't think it's the idea problem; I think it's the presentation problem. So, from the presentation standpoint, the paper could benefit from a serious re-writing.

From the idea perspective, the paper has some merit: the authors are attempting to model a dynamic system of multiple mutually-influencing nodes. While the paper is appropriately using concepts such as recurrent latent regimes, shared candidate score matrix, state-specific sigmoid gates, and top-k masks, the reality of the modeling is much simpler: each node can fire at any time and influence certain other nodes. The system is also multimodal, so some modes can appear at certain frequencies (e.g., seasonality), while others do not. This is a very complex problem, because both the nodes and the modes have to be modeled simultaneously. So the authors are proposing one shared candidate "wiring" diagram (PCDM), where different nodes are allowed to switch individual wires on and off with their own sets of gates. The idea is that doing so would allow to find rare, mode-specific wires that otherwise can be missed. The second piece that the authors propose, INFO, is a simple statistical model that ranks the nodes that matter most in each mode.

What the authors found was that PCDM did not work. INFO provided some useful node-specific wiring, but the idea did not hold, either, because it turned out that most of that added accuracy was already present when the simple wiring rearranged the gates. In other words, neither of the two components, introduced as novel by the paper, provided any improvement to modeling complexity of the dynamic causal system. Given the additional issues with presentation, this paper needs serious rework before it is ready for a conference.

Critical strengths

I think the most important strength of the paper is the effort to find the structure of influence in the multimodal dynamic causal system with nodes having the ability to mutually influence each other. Any work that gets us closer to discovering "true" causality outside the experimental design is a worthwhile attempt.

Specifically in this paper, I liked that the authors used the controlled evaluation objects appropriately. For the question of whether an edge is accurately evaluated to belong to the regime that uses it, PRIVATE AP, owner accuracy, signed margin, and finite-response NMSE are all good choices. Likewise, for evaluating the contribution of INFO, the authors used the matched restart controls such as KEEP, RANDOM with overlap matching, and screening-weight controls (POOLED, PERMUTED). So from that perspective the design was solid.

I also liked that the authors were careful in reporting the results, noting the intervals that include zero, and reporting nearly-null results upfront, in the abstract, stating that the benefit of sharing “remains to be established.” I also have to commend on the effort that produced the 45 pages of material for this study: even though the proposed ideas did not seem to work, at least the authors are no aware of what does not work and can look for what does.

Critical weaknesses

The most critical weakness is that the paper's title and abstract do not match the paper's contribution - or at least it does not seem that they do. The paper claims shared structure with local modulation as its contribution, but the results do not support the conclusion that sharing helps. These results are clearly stated in the paper itself, and given the null results, I wonder if the paper can be reframed in its current state. What the experiments seem to support is a different, much narrower contribution: that a posterior-weighted additive spline screen can assign private edges to their respective regimes.

But that result belongs to the screen rather than to the shared-plus-gated architecture the title indicates, and most importantly, such screens already exist. For example, ranking candidate inputs per target with an additive spline fit: the method proposed by Fan, Feng, and Song (2011) is nonparametric independence screening, which the paper cites but does not compare against. I think the comparison will show that Fan et al., 2011, will perform just as well as INFO, if not better. Another method, CAM, in the causal discovery literature specifically (Bühlmann, Peters and Ernest, 2014) uses preliminary neighborhood selection by additive regression, then order search, then pruning by significance tests in the fitted GAMs. The paper's proposed INFO’s “fit splines, rank, keep top-k per target” is CAM’s first and third steps without the order search.

I also noticed that the authors did not evaluate their proposed method against any of the competitors that they name in related work. I would have expected to see a comparison against at least one of the methods that evaluate dynamic causal discovery, some of which the authors mention: Regime-PCMCI (Saggioro et al. 2020), CD-NOD (Huang et al. 2020), the regime-structure learner of Rahmani and Frossard (2025), non-homogeneous DBNs (Grzegorczyk and Husmeier). On regime-switching data, the authors provide comparisons to PCDM's own ablations, but I don't think it's sufficient for comparison. In external baseline on DREAM3 (stationary, no regimes), PCDM performs worse than DYNOTEARS and NTS-NOTEARS on both macro metrics.

Questions for authors

Most of my questions are suggestions for future work. However, there are a couple of questions that could potentially affect my assessment.

  1. The run against the Regime-PCMCI, CD-NOD and the Rahmani-Frossard regime learner. If they were already run during the development and omitted in the paper, it's an answer in its own. But if they haven't been run, maybe they should be. If PCDM performs better than any of them, both the direction and the magnitude would matter.

  2. What distinguishes INFO’s screening step from the literature in the posterior-weighted additive spline neighborhood selection that I've mentioned in the previous section?

2 comments
AuthorsOpenReview ↗

Response to 4KvQ

Response to 4KvQ

Thank you for reading the paper closely. On rereading the experiments, we also found that understanding the comparisons meant going back and forth to the appendix. Section 4 now introduces the controls where they are used. Table 5(a) puts the complete spline pipeline alongside the two neural continuations.

1. Comparisons with external methods

We checked the archives and found no verifiable pre-submission records of completed runs for the requested methods. We have now compared linear Regime-PCMCI on five matched graphs per family using common training timestamps. On additive data, canonical INFO improved state ARI by 0.050 and boundary F1 by 0.437. Both gains passed correction. PRIVATE AP differences remain unresolved in both families. CASTOR used a single state in each run.

We also adapted the released SDCI code to the same observations and lag-one targets, with three states supplied to both models. Conditioned INFO gave response NMSE of 0.113/0.157 compared with SDCI's 1.028/0.992. Time-weighted ALL AP was 0.991/0.989 and 0.489/0.499, respectively. Table 5(a) gives both endpoints. Appendix F.6.1 describes the different state definitions, priors, capacities and budgets.

The nonlinear Regime-PCMCI and CD-NOD attempts used three paired seeds per family and method. Our rough estimate for completing these runs on a Ryzen 9 9950X3D workstation with an RTX 6000D was more than a month. We stopped the runs before completion and have no comparable results from those runs. On DREAM3, DYNOTEARS and NTS-NOTEARS still score higher than INFO on both macro metrics (Appendix B).

On OPPORTUNITY we hold out each of four participants and infer states offline from their sensor windows. Mean locomotion ARI is 0.1192 for conditioned INFO, 0.0808 for the complete simple pipeline and 0.0351 for the spline-HMM. INFO has higher ARI than both routes for all four participants. It also has lower reconstruction error than the spline-HMM for all four and lower error than the simple route for two (Appendix I).

2. The relationship to NIS, INIS-SpAM and CAM

We agree about the link to existing additive screens. INFO weights lagged observations by the inferred state posterior, ranks candidate parents and reassigns the existing gates at restart. We compared posterior-weighted INIS-SpAM and lagged CAM with the same observations and state weights. The joint screen's PRIVATE AP was higher than INIS-SpAM's by 0.00152 on additive data and 0.00080 on weak interactions. The advantage remains unresolved after correction against both comparators. Section 4.3 now explains how we use the screen to initialize the neural restart.

Sharing and subsequent learning

A fixed-posterior comparison showed a small response improvement from shared scores. Broader localization gains remain unresolved. Appendix A.1 gives an example in which a common score matrix produces disjoint hard supports and explains why the theory assumes common support.

Against KEEP and RANDOM, the clearest gain from INFO is the initial parent assignment. Decoder conditioning improved neural fitting on the original and new graphs. On the original graphs, fitting a spline on the same final parents and posterior still reduced NMSE by 0.0806/0.0429. None of the 12 condition–family combinations met the prespecified response-benefit criterion against both complete spline routes. The main text now reports these findings separately.

Thank you for running all the experiments I've asked for. I will raise my soundness score to 2 because your work is clearly accurate and competent. However, the results, as expected, confirmed my earlier concerns about lack of substantive contribution. I also looked at the revised paper, and it did not improve much. While undefined labels appear to be gone from the main paper, the appendix grew by another 10 pages or so, so the ratio of the main text to appendix got worse. I know appendices are unlimited, and now there are some cross-references (with the exception of sections 4.4 and 4.5, where I didn't find any), but the paper should be understandable as a stand-alone - and it still is not.

I will retain the score of clear rejection because this work did not fundamentally improve the paper's contribution, and in its present form, it is not ready for publication.

Reviewer_NZpKOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper studies causal discovery from multivariate time series whose lagged causal graph switches between a few recurring, unobserved regimes. The proposed model, PCDM, gives each candidate edge one score shared across regimes and lets each regime switch edges on or off through sparse gates, while a Transformer state posterior, trained on responsibilities from residual-based forward–backward inference, weights the regimes in an EM-style loop. The main practical addition is INFO, a one-time restart in which a posterior-weighted additive spline fit ranks each variable’s candidate parents, and the existing gate values are reassigned in that order before neural training continues. On synthetic data with additive and weakly interacting mechanisms, INFO clearly improves how often edges are assigned to the correct regime compared with matched restart controls, although the authors acknowledge that the benefit of sharing itself is not established.

Critical strengths
  • The problem is well motivated. The paper targets short, recurring regimes, where both smooth-drift models and fully separate per-regime graphs struggle.

  • The proposed INFO is simple, and its screening and reassignment step is inexpensive relative to neural training. Against well-designed matched controls, it gives large and consistent gains in assigning edges to the correct regime, and these gains hold on every evaluation graph in both synthetic families.


  • Seeds, settings and protocols are documented in detail, and the authors state that code and data are provided.

Critical weaknesses
  • The title and contributions centre on sharing structure across regimes, but this motivation is only partially supported. The main controlled experiments do not establish a consistent advantage from sharing for regime-specific edge recovery: against independently learned per-regime graphs, the localization intervals include zero, and the positive sharing effects that do appear are small or setting-specific. In addition, the finite-sample analysis assumes a support core common to all regimes, which the method does not enforce, since each regime’s parents are selected separately.
  • My main concern is that the experiments establish the value of informed screening more clearly than the value of the subsequent neural structure-learning stage. The additive spline screen is well matched to the principal synthetic mechanisms. Although the paper includes non-additive interactions, these are relatively weak and every interacting parent retains an additive main effect, so these experiments provide limited evidence of robustness when additive screening is misspecified. Edge rankings are already strong immediately after reassignment, the additive fixed-support control shows no statistically resolved benefit from continued support updates, and spline fits using the same final support and state posterior estimate the tested causal responses substantially better than the neural model. The appendix provides informative screening and spline diagnostics, but a complete comparison against a simpler posterior-plus-screening-plus-spline pipeline is still needed to establish what the neural continuation contributes.
  • The final INFO configuration is evaluated only in a favourable setting. The true number of regimes is supplied, the parent budget equals the true number of parents, regimes recur in a fixed order with equal dwell times, and every edge is calibrated to be clearly detectable.

  • The public benchmarks provide limited support. On DREAM3, AUROC is 0.539, close to the 0.5 chance level and below the stationary baselines DYNOTEARS and NTS-NOTEARS. On Sachs, the results are below most of the published methods listed. The fMRI simulation reports no baselines and does not say which simulation was used. None of these benchmarks has a known regime structure, so none can test the paper’s main claim, the recovery of regime-specific edges.

Questions for authors
  • What does neural learning add beyond the screen? How does a complete simpler pipeline (inferred state posterior, screened support and a spline predictor) compare with the full method?

  • How does PCDM compare with regime-switching methods on the controlled data? Please compare with Regime-PCMCI (Saggioro et al., 2020), CASTOR (Rahmani & Frossard, 2025) or SDCI (Balsells-Rodas et al., ICML 2025).

  • The method assumes lag-1 dependencies at the measured sampling rate, but in many target applications, fMRI in particular, the measurement timescale is much slower than the causal timescale. Under such undersampling, the measured lag-1 graph can differ substantially from the true causal graph. How would PCDM behave under undersampling? In particular, could some of the recovered “private” regime-specific edges be artifacts of undersampling rather than genuine mechanism changes?

1 comment
AuthorsOpenReview ↗

Response to Reviewer NZpK

Response to NZpK

Thank you for asking us to separate parent screening from the learning that follows it. Your question helped us identify the complete pipeline we needed to compare against.

1. The complete simple pipeline and neural continuation

Both routes start from the same BASE posterior and parent screen. One fits a spline on the selected parents. The other continues neural training. Using the inferred posterior, the complete simple pipeline reduces response NMSE by 0.654 and 0.625 relative to canonical INFO on additive and weak-interaction data. Submitted Tables 18 and 25 included the same-input spline comparisons. The additive result for the simple pipeline also appeared in Table 18. Section 4.4 now presents these comparisons together.

We then raised the input gain and removed spectral normalization at restart. On the original graphs, neural NMSE fell from 0.764/0.823 to 0.113/0.157, close to the simple pipeline's 0.110/0.198 (Table 5(a)). With parents and posteriors fixed, changing gain produced the larger improvement. Following your suggested comparison, we refitted a spline with conditioned INFO's final parents and posterior. It reduced NMSE by a further 0.0806/0.0429. Both reductions passed correction.

The decoder improvement held on five new graphs per family. On weak interactions, conditioned INFO still had 0.0343 higher NMSE than the simple pipeline, and the difference passed correction. The additive difference remains unresolved. The spline-HMM estimates its own states from the observations and outperformed conditioned INFO in both families (Table 5(b)). The conditioned route did not meet our prespecified response-benefit criterion against both complete spline routes in any of the 12 combinations we tested. The clearest gain is at parent assignment.

On OPPORTUNITY we hold out each of four participants and infer states offline from their sensor windows. Mean locomotion ARI is 0.1192 for conditioned INFO, 0.0808 for the complete simple pipeline and 0.0351 for the spline-HMM. INFO has higher ARI than both routes for all four participants. It also has lower reconstruction error than the spline-HMM for all four and lower error than the simple route for two (Appendix I).

2. Comparisons with switching methods

We adapted the released SDCI code to the same observations and lag-one targets, with three states supplied to both models. Conditioned INFO gave NMSE of 0.113/0.157, compared with SDCI's 1.028/0.992. Time-weighted ALL AP was 0.991/0.989 and 0.489/0.499, respectively. All four differences passed correction (Table 5(a)). Appendix F.6.1 describes the differences in state definitions, priors, capacity and training budgets.

We also compared linear Regime-PCMCI on five matched graphs per family. In the additive setting, canonical INFO improved state ARI by 0.050 and boundary F1 by 0.437. PRIVATE AP differences remain unresolved. CASTOR used one state in every run. The nonlinear Regime-PCMCI and CD-NOD attempts used three paired seeds per family and method. Our rough estimate for completing these runs on a Ryzen 9 9950X3D workstation with an RTX 6000D was more than a month. We stopped the runs before completion and have no comparable accuracy figures.

3. Undersampling and private edges

Taking every fourth observation in stationary controls added 31.6 and 29.6 apparent private edges per inferred state in canonical INFO for the two families. Both increases passed correction. We score fine-scale edges and coarse effective influences separately. At fourfold subsampling, response error was close to that of a zero-response predictor. This motivates caution with the NetSim example, where we lack regime-specific edge truth.

Sharing and experimental settings

A shared score matrix permits disjoint hard supports, so the theory requires an additional common-support assumption (Appendix A.1). Small parent or state budgets miss structure. Larger budgets can introduce absent edges or split a state. Appendix F also reports unequal dwell, rare states, moderate signals and pure products. In the balanced moderate-signal timing study, both routes shared about 56 minutes of BASE fitting and preparation. The spline took about 30 seconds more and canonical INFO about 56 minutes more.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.