- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CauTwin to estimate patient-specific treatment effects from observational data. It uses propensity score matching to construct treatment effect targets and introduces a batch-centered contrast loss to learn differences in treatment effects across patients. The paper evaluates the method on three ICU datasets and the results show improved treatment effect direction and patient dependence on ICU data.
Critical strengths
The combination of contrast supervision and adversarial balancing is novel.
The experiments include three ICU datasets from different hospital systems and provides detailed implementation settings.
Critical weaknesses
Some key assumptions and design choices need further clarification, including the shared matching bias assumption and the different treatment definitions used in matching and counterfactual rollout.
Although modeling ICU treatments is challenging, the authors should better consider real clinical practice, including differences in vasopressor types and treatment duration. The current evaluation provides limited evidence of treatment effect accuracy and clinical utility. Moreover, the semi-synthetic experiments do not use the proposed contrast supervision.
Questions for authors
-
Counterfactual rollout and treatment definition. Appendix C.1 defines the counterfactual rollout as sustained vasopressor treatment over 12 hours, and Appendix C.2 defines a patient as treated if vasopressors were administered at any point during the window (median duration of 7 hours). How does this difference affect the estimated treatment effects? Batch centering removes a shared offset, but may not account for differences in treatment duration across patients.
-
Treatment conditioning. In Section 4.1, the authors state that an additive treatment input would shift every patient's prediction by the same amount and therefore cannot represent patient-dependent treatment effects. A nonlinear Transformer should already be able to model interactions between treatment inputs and patient representations.
3.Assumption on matching bias. The contrast loss assumes that matching errors are approximately shared across patients. What evidence supports this assumption in the ICU cohorts?
4.Clinical treatment setting. Have the authors considered the differences among vasopressor types?
5.Evaluation metrics. The ICU evaluation mainly relies on Correct Direction and Patient Dependence. Could the authors provide additional analyses, such as examining whether patients who received treatments consistent with the model's recommendations had better clinical outcomes than those who did not?
6.Other concerns. Appendix E.2 shows that the tumour benchmark did not use the proposed contrast supervision. Could the authors explain why the main method was not used in this experiment?