- Rating
- 3
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper suggest a method that combines forecast derived vital features with mortality outcomes retrieved from similar training patients. The paper is clear and we'll written.
Critical strengths
- Good results
- Squeezing more signal from the data
Critical weaknesses
Poor evaluations, you didn't try the real SOTA or at least AutoML methods The hyperparameters of the comparison methods are missing and the delta between LR and xgoboost are strange
Questions for authors
Did you use early stopping on XGBoost? Did you search for the hyperparameters in the comparison methods?
Thank you for requesting a broader comparison and clearer information about baseline training. We have expanded the evaluation to include TabICLv2, DuETT, GARLIC, TPC, and ALFIA, alongside Logistic Regression, XGBoost, GRU-D, and Medformer. The models are fitted or trained and evaluated separately on MIMIC-IV and eICU-CRD, using the matched 0–36-hour observation window, patient-level splits, and in-hospital mortality endpoint. The reported experiments use three seeds, with standard deviations shown where available.
1. Expanded comparison with relevant predictors.
On MIMIC-IV, TRACE has the highest mean AUROC and AUPRC among the evaluated models. Its AUPRC exceeds XGBoost by 0.0346 and the strongest baseline mean AUPRC, obtained by TPC, by 0.0330. On eICU-CRD, TRACE is close to XGBoost and GRU-D in mean discrimination, while TabICLv2, DuETT, TPC, and GARLIC achieve higher values. These results will be included in the revision to give a fuller account of the framework's relative performance across cohorts.
The added evaluation also helps distinguish overall performance from the contribution of the proposed pipeline. With the same retrieval module added to a directly trained iTransformer classifier, TRACE still improves AUPRC from 0.4909 to 0.5127 on MIMIC-IV and from 0.2224 to 0.2371 on eICU-CRD. We will present these controlled comparisons alongside the expanded baseline table.
2. Logistic Regression versus XGBoost.
The repeated evaluation gives the following results.
XGBoost's mean advantages over Logistic Regression are 0.0199 AUROC and 0.0270 AUPRC on MIMIC-IV, compared with 0.0036 and 0.0036 on eICU-CRD. Thus, the size of the gap varies across the two cohorts. A plausible modeling explanation is that Logistic Regression imposes a linear log-odds relationship over its input features, while XGBoost can capture nonlinear relationships and feature interactions. This interpretation concerns the model families. The training and model-selection procedure for the expanded evaluation is detailed below.
3. Hyperparameter search and XGBoost early stopping.
For the expanded XGBoost evaluation, we performed a 60-trial random hyperparameter search and selected the configuration by validation AUPRC. Within each trial, early stopping monitored validation log-loss with a patience of 100 rounds and a maximum of 5,000 boosting rounds. Thus, validation log-loss determined when to stop boosting, while validation AUPRC determined which configuration to select.
Logistic Regression used standardized features with the L-BFGS solver, C = 1.0, balanced class weights, and a maximum of 2,000 iterations, following the fixed configuration used in Table 2 without additional hyperparameter search.
The expanded comparison and repeated evaluation provide a broader empirical basis for assessing TRACE. We will use the cohort-specific results above to state its strengths and limitations precisely, and provide the training details needed to make the comparison reproducible.