- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes identifying latent linear-Gaussian dynamics by combining known state-dependent policies across environments. The policy-spanning argument provides an interesting way to fix latent coordinates. The question is relevant, and the synthetic experiments suggest benefits from combining diverse policies.
Critical strengths
Using known policies to anchor latent coordinates is an interesting idea. The policy-spanning argument is interpretable and addresses a relevant distinction between predicting observations and recovering latent dynamics.
Critical weaknesses
The main concern is the justification of Theorem 1. Appendix A.2, lines 652-659, moves from collective emission injectivity to a shared affine latent transformation and pointwise policy preservation. I could not establish these steps under the stated noisy, action-dependent emission model. This is a concern about the proof provided, rather than a demonstrated counterexample to the theorem.
Algorithm 1 also assumes PCA recovers Zhat=MZ, which does not generally follow from nonlinear emission injectivity. The ASSISTments validation additionally needs clarification about policy coordinates and school splits.
Questions for authors
-
Theorem 1 needs a clearer model-equivalence argument. Appendix A.2, lines 652-659, moves from collective emission injectivity to a shared affine latent transformation and pointwise equality of policy probabilities. I could not establish these implications from the stated assumptions, particularly with noisy, action-dependent emissions. Could the authors supply the missing argument or clarify the required assumptions? Once a shared policy-preserving transformation is established, the spanning argument appears valid. This concern is about the proof provided; I have not established that the theorem is false.
-
The estimator's scope is unclear. Algorithm 1 assumes PCA recovers Zhat=MZ, although the formulation permits nonlinear injective emissions. Injectivity alone does not ensure this: for standard Gaussian Z and g(z)=(z,z^2), population one-component PCA retains z^2-1 and loses the sign of Z. Is the solver intended for a narrower linear-emission setting? Please specify the conditions supporting its recovery claim and explain how its transition regression relates to Equations 7-9.
-
The real-data interpretation needs clarification. ASSISTments policies are estimated rather than supplied as known latent-coordinate functions. How are their coordinates anchored consistently across schools? Please also specify the school subsets used for Table 3; the description of disjoint leave-one-out subsets is ambiguous. The reported agreement is useful evidence of stability, but does not by itself establish identification.