- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper proposes a framework for proper scoring of right-censored survival outcomes: the predictive distribution is first mapped through the censoring mechanism, and the underlying proper score is then applied to the induced observed-data law. This yields localized scores for fixed censoring times and marginalized scores for random or partially observed censoring, with the censoring law held fixed independently of the forecast. Proposition 1 establishes propriety under conditionally independent censoring and identification of the latent joint CDF on the identifiable region. The construction recovers the censored NLL and IPCW Brier score as special cases and gives right-censored versions of the CRPS, pinball loss, and energy score. The censored energy score is further used as a training objective (censored engression) for likelihood-free modeling of multivariate, co-occurring event times. Validation includes controlled simulations showing the proposed scores preserve the oracle ranking while forecast-dependent plug-in scores can reverse it, synthetic multivariate experiments, and an ICU AKI case study on MIMIC-IV.
Critical strengths
- Starting from the principle of first censoring the predictive distribution according to the observation mechanism and then applying a proper scoring rule, the paper derives right-censored versions of commonly used evaluation scores. It covers both fixed censoring through localization and random or partially observed censoring through marginalization. Existing criteria, including the censored NLL and IPCW Brier score, are recovered as special cases within a unified framework. These scores can also serve as learning objectives. Building on this connection, the authors propose censored engression, extending engression to multivariate right-censored outcomes and enabling likelihood-free modeling of potentially co-occurring event times.
- The experimental results support the effectiveness of the proposed approach. The theory is clearly presented.
Critical weaknesses
None. I did not find any major weaknesses. The notation is heavy and easy to confuse; I suggest adding a unified table of notation.
Questions for authors
The naive baseline treats censored values as event times. Could the authors also compare against complete-case engression (training only on uncensored samples) and an IPCW-weighted energy score, which are more standard naive alternatives?
3 comments
Dear Reviewer,
Thank you for your thoughtful review and contribution to the discussion.
As the discussion period approaches its conclusion, I would like to kindly remind you to review the authors' rebuttal and engage in the discussion if you have not already done so.
In particular, it would be helpful if you could indicate whether the authors have adequately addressed your concerns and, if appropriate, reconsider your assessment and score.
Thank you again for your time and effort!
Thanks for the detailed response and revision. The new baselines and the notation table address my questions. I have no further concerns and am happy to maintain my positive score.
We thank the reviewer for the positive assessment of our paper.
We also appreciate the suggestion to include complete-case engression and IPCW-weighted energy-score training as additional baselines. We have added both in the synthetic experiments and the real-data AKI use case. Censored engression consistently achieves the lowest censored energy score. For example, at k=2, censored engression scores 0.4904 versus 0.5236 for IPCW and 0.5710 for complete-case engression. At k=10, the respective scores are 1.3382, 2.3976, and 2.5101. IPCW improves over naive engression at low dimensions but performs worse at higher dimensions.
Finally, we have added a unified notation table in the appendix to improve readability.