- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper introduces several concepts related to predicting the future of a system under interventions. Operational Memory is taken to be the historical information of a system that is predictive of its response to interventions. A CCA decomposition of history features and future response features gives singular values termed the Operational Predictive Memory Spectrum. A context-resolved version, which conditions on context and prevents cancellation between different contexts, is also presented. Lastly, a concrete realization of a finite predictive state variable under linearity assumptions is termed the Operation-Complete Predictive Realization. Evaluation is presented on physical systems, where the primary evaluation metric is an metric of predicted response differences under different histories.
Critical strengths
Generating representations that are predictive of future trajectories under different interventions is an important research direction. The proposed CCA-based approach is sound and reasonable under the stated linearity assumptions.
Critical weaknesses
Major clarity issues: The methods and experiments sections are very difficult to follow. Many concepts are simply presented mathematically and under-explained in the text. Additional terms like context , context strata , and intervention depth are undefined. In the experiments section, there seems to be insufficient detail to interpret all the presented results, at least for non-experts in this precise area. For example, TLS is defined as two-level-system in the caption of Figure 2, but "fitted TLS fraction" is not explained anywhere in the main text or appendix, from what I can see. Table 1 contains raw numbers without context (e.g. 0.006256 > 0.000468). Both sections could benefit from explaining less using more space.
Low significance and novelty: The core methods are CCA (Eq. 3) and CCA with conditional covariances (Eq. 4). I do not believe these methods and associated results are substantially novel and significant to an ICLR audience. Citations are provided for modern sequence-to-sequence SSMs such as S4D and S5, but no meaningful comparison is given, either conceptually or experimentally.
Questions for authors
None
3 comments
Response to Reviewer F8Dj (2/2)
W2. A meaningful comparison with S4D, S5, and recursive-state models was missing.
The original manuscript cited S4D and S5 without providing a sufficiently meaningful comparison. We have now added a controlled comparison of our implementations of TCN, S4D-style, and S5-style history encoders using identical 64-step inputs, response targets, five random seeds, and a shared 16-dimensional response representation:
| Encoder | Intermediate | Structured |
|---|---|---|
| TCN | 0.910 ± 0.022 | 0.867 ± 0.028 |
| S4D-style | 0.889 ± 0.026 | 0.849 ± 0.027 |
| S5-style | 0.915 ± 0.026 | 0.909 ± 0.024 |
Values are five-seed mean ± sample standard deviation of Causal Skill; higher is better.
The result shows that modern SSM encoders can indeed retain substantial intervention-relevant historical information, with S5-style performing best in this controlled encoder comparison. We therefore do not use this experiment to claim that OCPR simply outperforms S4D/S5.
The comparison addresses a different question. These encoders directly map observed history to a fixed future-response representation. OCPR additionally identifies operation-specific predictive-state updates from limited intervention depth and recursively composes those updates at unseen intervention depth. The S4D/S5 comparison does not use this same recursive-identification protocol, so the scores should not be interpreted as a direct method-level ranking against OCPR (App. G.2, Table 5).
Beyond this encoder comparison, the revision also adds recursive-state baselines that more directly probe OCPR’s central claim. Two learned 16-dimensional recurrent controls retain high trajectory but lose matched-history response-difference geometry at held-out horizons (App. G.1, Fig. 13).
We also added an external OQE/system–memory baseline. At the held-out depth-three endpoint, OQE retains ordinary-response but obtains Causal Skill , compared with for center–gap OCPR on the same 30-pair response-derived comparison (App. G.3, Table 6). Because OQE uses a different response representation and information interface, we report it as an external comparison rather than a strictly matched ablation.
This experiment has been added to the supplementary material, and the conceptual distinction is now stated explicitly in the revised Related Work.
Official Comment by Authors
We sincerely thank the reviewer again for the thoughtful comments and suggestions. We hope these revisions address the reviewer’s concerns and that the reviewer will reconsider their assessment in light of the revised manuscript.
Response to Reviewer F8Dj (1/2)
We thank the reviewer for carefully reading our paper and for raising important questions about our method. We have carefully considered the concerns regarding presentation, significance, novelty, and the relationship to modern state-space models, and revised the manuscript accordingly.
W1. What is novel beyond established CCA and Hankel realization tools?
For the unclear presentation in the original manuscript, we have substantially revised the Methods and Experiments. Matched context, context strata, and intervention depth are now defined before use, and experimental quantities such as the fitted TLS fraction and matched-null thresholds are explicitly explained.
Regarding novelty, we agree that CCA, conditional covariance, and classical Hankel realization are established tools, and we do not claim these mathematical tools themselves as new. We also apologize that the original presentation did not sufficiently distinguish these established mathematical ingredients from our actual contributions, which may have made our work more difficult to understand.
Our contribution has three levels.
First, we formalize Operational Memory: historical information that remains predictive of responses to the same future intervention after the observable present is matched. Proposition 1 proves that ordinary prediction does not certify this information: trajectory R2 can approach one while intervention-response recovery becomes arbitrarily poor.
Second, OPMS characterizes this operational dependence. CCA provides its canonical geometry, while the context-resolved construction places residual responses from different context strata into separate blocks,
QCR=eβ⊗Q∘,
before spectral analysis. This prevents cross-context cancellation. Proposition 3 shows that the context-resolved statistic is zero only when every retained within-context cross-covariance is zero, whereas the pooled statistic may vanish despite predictive dependence in every context.
Third, OCPR is separate from CCA. It constructs a finite predictive state with operation-specific updates identified from limited intervention depth. OCPR combines exact intervention coordinates, center–gap realization, and depth-restricted update identification, together with restricted-rank and finite-horizon perturbation guarantees.
The central experiment identifies all updates using responses with at most two interventions, excludes third-intervention responses from identification, and then composes the same updates to predict the unseen third intervention. This achieves Causal Skill 0.993/0.998 with response-derived states and 0.966/0.971 with history-inferred states.
The downstream decision experiment further shows that these distinctions matter: among 12 cases where matched histories require different optimal interventions, history-inferred OCPR recovers both actions in 11 cases and response-derived OCPR in all 12 (App. H.1, Table 7).
We have revised the manuscript to make the separation between established mathematical tools and these problem, construction, realization, and theoretical contributions much clearer.