- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Overall, this paper addresses an important and practical problem—alleviating the negative impact of measurement observation noise on temporal causal representation learning. The problem formulation is novel, and the proposed approach using free-energy particle dynamics for latent space denoising is supported by decent theoretical guarantees.
Critical strengths
-
The motivation to address measurement observation noise in temporal causal representation learning is logical and practical, tackling a crucial bottleneck toward real-world applicability.
-
The proposed LDMS framework is backed by decent theoretical proofs, providing clear guarantees for mechanism strength stability, sparse support preservation, and joint estimation consistency.
Critical weaknesses
- The authors compare their proposed method against only a single baseline: the mechanism-sparsity VAE without the denoising regularizer[8, 25]. The paper fails to include comparisons with existing mainstream temporal causal representation learning methods (e.g., LEAP, TDRL, CITRIS, CtrlNS)[ 2, 11, 12] or robust/denoising ICA baselines[2, 11]. Without these benchmarking results, there is no clear evidence that LDMS offers a distinct performance advantage over the state-of-the-art[8, 30].
- In key evaluation experiments (e.g., Table 1 and Table 2), LDMS incorporates a lower-triangular support prior, whereas the baseline employs an unrestricted candidate support. This asymmetric setup introduces a major confounding factor, making it impossible to determine whether performance gains stem from the latent particle denoising module itself or merely from the stronger structural prior.
- Although the authors claim that the denoising module is "plug-and-play", it is only integrated into a single framework without demonstrating efficacy on alternative CRL backbones. Furthermore, essential ablation studies on hyperparameter sensitivities (e.g., particle count , inner update steps , and denoising loss weight ) are completely missing, leaving the isolated contribution and robustness of the module unverified.
Questions for authors
See Weaknesses.
Latent-Space Denoising for Temporal Causal Representation Learning with Mechanism Sparsity
We thank the reviewer for the constructive comments. We address the concerns regarding baseline comparisons, structural priors, and hyperparameter robustness below.
W1: Comparisons with Existing Methods
The current experiments mainly compare LDMS with the mechanism-sparsity baseline. To provide a more comprehensive evaluation, we include representative temporal causal representation learning methods, namely LEAP, TDRL, and CtrlNS [1,2,3], as well as SNICA [2] as an additional baseline. All experiments are conducted on the TimeNonDiag dataset introduced by Lachapelle et al.[4], with 100,000 samples, and each experiment is repeated independently five times. The table below summarizes the comparison results.
LDMS achieves the best performance in terms of MCC for latent variable recovery, indicating that the latent-space denoising module helps improve latent variable recovery accuracy.
W2: Experimental Comparisons
We agree with the reviewer that the use of different structural priors may affect the fairness of the comparison between the baseline and LDMS, making it difficult to isolate the contribution of latent-space denoising.
To address this issue, we conducted two sets of controlled experiments: (1) neither method uses the lower-triangular support prior; and (2) both methods use the same lower-triangular support prior. In both settings, all other model architectures, training configurations, and evaluation procedures are kept identical. The corresponding results are presented in our response to Reviewer dQ2z, under Q2 & W3: Experimental Fairness and the Contribution of Denoising. These controlled experiments allow us to evaluate the contribution of latent-space denoising more fairly under matched structural assumptions.
W3: Generalizability and Hyperparameter Robustness
We conduct sensitivity analyses on the hyperparameters that may affect the performance of the latent-space denoising module, including the number of particles N, the number of inner particle updates Kiter, and the denoising weight λD.We evaluate each configuration on TimeDiag with five random seeds.The results are shown in the following table.
The results show that LDMS is sensitive to the choice of hyperparameters. In particular, λD=0.025 achieves the highest MCC and lowest Latent RMSE, while a larger weight (0.2) degrades latent representation recovery. These results highlight the importance of appropriate hyperparameter selection.
In addition, we will further clarify the scope of this study. LDMS integrates latent-space denoising based on free-energy-guided Wasserstein particle flows into the mechanism-sparsity framework. Our experiments demonstrate the effectiveness of this specific combination. However, we have not fully explored whether the denoising module is compatible with other causal representation learning methods. We will discuss its potential for use in other causal representation learning frameworks in the revised paper. Further exploring its integration with these methods will be an important direction for future work.
We thank the reviewer again for the helpful suggestions. We believe the proposed revisions will strengthen the experimental evaluation and clarify the scope of LDMS.
References
[1] Gradient Flows in Metric Spaces and in the Space of Probability Measures, Birkhxauser,2008.
[2] Disentangling Identifiable Features from Noisy Data with Structured Nonlinear ICA, NeurIPS, 2021.
[3] Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA, NeurIPS, 2016.
[4] Nonparametric partial disentanglement via mechanism sparsity: Sparse actions, interventions and sparse temporal dependencies. JMLR, 2026.