- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies counterfactual inference for discrete variables under Gaussian process SCM with a known DAG. The paper proposes a unifying framework for binary, categorical, and ordinal outcomes. The authors proposes a method for estimating the conditional noise distributions given the observation. The paper provides synthetic experiments to investigating the effects of misspecifying coupling between the counterfactual and the observations. This demonstrates that accurate conditional probability estimation, i.e., predictive fit, does not automatically lead to accurate counterfactual estimations.
Critical strengths
- carefully designed ablation experiments that demonstrate the effects of wrong couplings
Critical weaknesses
- The contributions seem limited and incremental. The ablation study is largely empirical. The computational method seems lacking advancement.
- The justification for the selected counterfactual couplings seems not strong enough. Ordered categories seem to me do not automatically imply preservation of an individual’s latent rank across interventions.
Questions for authors
-
What assumptions beyond outcome type justify the chosen coupling, and how sensitive are the results to alternative couplings?
-
Can it be demonstrated that posterior averaging improves counterfactual uncertainty calibration compared with point estimates, since Table 3 evaluates only point-estimation error?