- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies the semantic ambiguity of learned causal representations in dynamical systems, where different latent blocks may mix information from multiple underlying exogenous mechanisms. Under an affine representation assumption and sufficiently informative anchor interventions, the authors derive bounds on cross-block mixing and propose ECRL to improve intervention-effect prediction. Experiments are conducted on synthetic dynamical systems to evaluate the proposed method.
Critical strengths
- The question studied in this paper is very interesting: learned latent blocks may mix information from multiple underlying mechanisms and when doing intervention of the mechanisms, the falsely matched latent variables may lead to suboptimal performance of modeling the changing exogenous mechanisms and predicting the intervention.
- Under proper assumptions, the authors build a theoretical bound showing how the mismatched cross-block mixing is controlled. And motivated by this analysis model, they proposed the method ECRL and experiments on controlled synthetic datasets show its effectiveness.
Critical weaknesses
- The methodology part remains unclear: the motivation like why introducing orthogonal head or adding the four different loss terms remains unclear, some notations like are not introduced, the numerical values like 0.18, 0.16, 0.06 in and total loss remains heuristic and authors didn't explain how they are obtained. When introducing training, why adopting three-stage training also remains unclear and seems heuristic.
- The theory contribution seems to be marginal: Theorem 1 simply applies and Proposition 2 applies Hoeffding's inequality for concentration. The final bound still relies on an unknown parameter which seems critical to how the cross-block mixing diminishes. Authors didn't analyze this part. Also, for experiment part, Figure 2 adopts so the inequality of Eq. (3) reaches the equality condition so this is tight. The experiment says nothing when is non-isotropic.
Questions for authors
- The paper introduces both theory and experiment method. However, the connection between them is not sufficiently established, particularly regarding how the theoretical guarantees motivate the actual learning objective.
- The paper is generally well-written. However, some key concepts for understanding the method are not well-explained and might hinder the reading.
- "AI Use Statement" Section is missing in the paper.
We thank the reviewer for the positive assessment of the research question and the theoretical connection between anchor responses and semantic mixing. We address the methodological clarity, theoretical contribution, and reporting concerns individually below.
Weaknesses
We clarify the mathematical and empirical roles of these design choices and complete a 480-run controlled audit across 24 configurations and 20 paired seeds.
D1 establishes the orthogonal head's metric-preservation property; general invertible transformations preserve zero-intervention prediction when the correct inverse is used, but can change innovation-response scale.
D2 establishes independent roles for Localization and Margin. Removing Localization increases OOD effect MSE by 0.11056, while removing Margin increases it by 0.04501. We also report coefficient and threshold sensitivity.
D3 shows that Joint-24 improves Selectivity, ID rollout MSE, and OOD effect MSE over the original 12/8/4 schedule. Thus, the original staged schedule is a documented design choice rather than a necessary condition.
We also clarify empirical innovation-mean notation and distinguish the margin threshold m=0.18 from the three auxiliary loss coefficients.
Please see Common Questions, Q4.
The contribution concerns named-block semantic identification and quantitative residual-mixing control, not the individual concentration inequalities.
We extend the theoretical analysis to rank-deficient anchors, partial identifiability, sharpness, and optimal coverage.
C1 explicitly varies Gram condition numbers from 1 to 100. Under a fixed excitation budget, γk decreases from 0.3200 to 0.00634, while the median finite-sample bound ratio increases from 8.77 to 60.86 at N=10,000.
C2 demonstrates that covariance contrasts can restore a direction invisible to mean shifts, increasing moment-visible dimension from 1 to 2.
These experiments directly address anisotropic coverage and the distinction between certificate validity and tightness.
Please see Common Questions, Q2.
Questions
The approximate-affine extension links absolute off-target innovation responses to residual cross-block mixing.
The Localization objective directly encourages target-specific response allocation, and E3 tests the connection empirically. Adding Localization raises Selectivity from 0.5442 to 0.8410 and reduces absolute off-target response from 0.016280 to 0.002601.
The theoretical bound and learning loss use related but distinct response quantities; the audit measures both rather than treating them as interchangeable.
Please see Common Questions, Q1, and the objective analysis in Q4.
We expand the definitions of named exogenous blocks, matched anchor contrasts, learned innovation means, normalized response energies, the orthogonal orientation head, and the three auxiliary loss terms.
We also explain the training stages and report direct architectural, coefficient-sensitivity, and schedule comparisons.
The mathematical identities and implementation details are organized in Sections 5.1–5.3 and Appendices K.1–K.3, with controlled design audits in Appendix K.7.
Please see Common Questions, Q4.
Thank you for identifying this omission. We will add a dedicated AI Use Statement in accordance with the submission requirements, accurately disclosing any AI-assisted activities and their scope. The authors remain responsible for verifying the scientific claims, derivations, experimental results, references, and final manuscript.