- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes CausalExoFormer, which explicitly learns variable relevance, historical lags, and interactions among exogenous variables for time-series forecasting. Building on TimeXer, it integrates a source–lag gate, a directed graph with NOTEARS-based acyclicity regularization, and null-augmented cross-attention, together with a shared graph and target-specific self-exclusion for multivariate forecasting. Proposition 1 establishes computational information-flow exclusion under gate closure. Across six standard benchmarks and six lake dissolved-oxygen datasets, the model achieves the best horizon-averaged MAE on all six standard benchmarks and MSE on four. The paper also reports ablations, synthetic source-and-lag recovery, and a real-data interpretation case study.
Critical strengths
- Operational control of information flow. The gate acts on both direct and graph-mediated pathways, and Proposition 1 shows that closing a gate excludes the corresponding observation from the external forecasting pathway.
- Explicit separation of source relevance and lag allocation. The factorized source–lag gate makes these quantities separately inspectable, and the synthetic experiments report stronger source and lag recovery than PCMCI+ and DYNOTEARS.
Critical weaknesses
-
(Readability) Although the paper is generally well organized, its readability is hindered by cumbersome notation and inconsistencies between the architecture figure and the equations. In Sections 2–3, the numerous indices and mappings, including , , , , and , make the central mechanism difficult to follow. The training objective in Figure 1 contains and , which are absent from Equation (11), while the cross-attention diagram omits the null alternative in Equation (9). The descriptions of zero diagonal and self-exclusion may also be conflated, and the section reference for the training schedule is incorrect. These issues obscure the correspondence between the illustrated architecture and its actual computation.
-
(Reproducibility) The computational properties of the proposed method are described mathematically, but the experimental evidence does not sufficiently support its central claims. The standard-benchmark and lake forecasting experiments do not report numbers of repeated runs or variability across seeds, while many improvements over strong baselines are on the order of 1–2%. In particular, the reported 8.1% average MSE improvement over TimeXer on Weather relies heavily on the gain at ; excluding that horizon reduces the improvement to approximately 1.8%.
In the ablations, removing the graph or DAG penalty increases average MSE by only about 1.4% each, and some datasets improve when these components are removed. These ablations are restricted to , limiting evidence for a consistent contribution across forecasting horizons. Furthermore, although the synthetic data have a known ground-truth directed graph, Table 3 evaluates only source and lag recovery, not recovery of the learned graph . Finally, the standard-benchmark baseline results are taken from earlier publications, while the execution settings for several lake baselines and the precise lake station identifiers and observation periods are not sufficiently documented. The procedure for selecting the default hyperparameters used in the sensitivity analyses also remains unclear, limiting the assessment of reproducibility and comparative reliability.
- Weak points
- Missing validation of directed-graph recovery. Even with a known synthetic ground-truth graph, the paper does not report how accurately the learned recovers it. Computational pathway exclusion does not establish causal correctness.
- Insufficient statistical support for performance gains. Many improvements are small, but repeated-seed means and variability are not provided for the forecasting experiments; some gains are concentrated in particular horizons.
- Limited contribution of the graph and DAG penalty. Their removal causes only small degradations on average and sometimes improves performance, while the ablations cover only .
- Incomplete reproducibility details. The comparisons reuse published baseline numbers, and the lake baseline settings, precise station and observation-period information, and hyperparameter selection protocol are insufficiently specified.
- Limited structural interpretation. The synthetic experiment uses a linear SCM, and the real-world interpretation focuses on a few variables from Erie2, without a systematic assessment of structural stability or domain validity.
Questions for authors
- Graph Recovery: Given that the synthetic data include a ground-truth directed graph, why are edge precision, recall, structural Hamming distance, or comparable recovery metrics for the learned not reported? Can these results be provided?
- Contribution of Graph Learning: Removing the graph or DAG penalty changes average MSE by only about 1.4%, and some datasets improve. What additional evidence demonstrates a substantive benefit beyond the source–lag gate? Does this benefit persist at other horizons?
- Statistical Reliability: How many random seeds were used in the standard and lake forecasting experiments? Can means and standard deviations from repeated runs be provided, particularly against closely performing baselines such as CrossLinear?
- Experimental Protocol: What were the training settings for the lake baselines other than CrossLinear? How were the default hyperparameters in Tables 10–12 selected independently of the test sets?
- Causal Interpretation: How do the authors distinguish the computational exclusion established by Proposition 1 from recovery of causal structure? What assumptions would justify interpreting the learned directed graph causally?