- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper is focusing on the distributional treatment effects (DTE) for evaluating the policy impacts under real-time monitoring. This paper proposed SMART which us linear-quadratic dynamic model as backbone to estimate the distributions over time with asymptotic normality and valid inference.
Critical strengths
- The question of paper discussing is novel and practical in real-world application.
- paper is well-written, and the experiments includes synthetic and real-world application.
Critical weaknesses
- In the related work section, there is missing reference of Causal distributional estimation, e.g., https://arxiv.org/abs/2209.06203. And the section is badly written, since the author just dumped all the citations in without carefully distinguishing the key contribution of the papers. It makes the contribution of SMART weak.
- In the problem setup section, the paper never define the population of random variables. But the paper is focusing on the distributional effect. IMHO, here should have more clear definition and then the target estimand could be well-defined.
- Also there is missing the classic causal assumption which is need for ATE estimations. I think they are implicitly stated in the Linear dynamical system, but writing out would be easier for reader to read.
- Equation (2) and Algorithm 1 appear to use an uncentered multiplier estimator, whereas Appendix B.7 proves validity for a centered residual bootstrap around the original OLS estimate. Please clarify which version is implemented and whether in Equation (5) is a complete bootstrap estimate or a centered perturbation, since this distinction directly affects the claimed sequential Type-I error control.
Minor:
- Line 045 there is a missing space between "mean outcomesJohari", and line 052 "discussedChernozhukov".
- Line 092, there are double brackets in the first sentence of related work section. "((see Larsen et al., 2024; Quin et al., 2024, for recent reviews)),"
Questions for authors
Questions for authors
- For the discrete-time linear dynamical system, the is only rely on and . Does this time-dependent enough? Or should the author consider more steps before time , e.g., and .
- I think in the problem setting section, the definition of and the policy takes form are a bit contradict to each other. Is the or what is the relationship between these two.