- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes REBASE, a framework for learning from heterogeneous tabular datasets with different feature sets and semantic descriptions. It represents each sample as a graph using language-model embeddings and a shared graph attention encoder, then matches the sample graph to learned prototype graphs using Fused Gromov–Wasserstein distance. These distances determine sample-specific weights for combining the prototypes’ predictions. The shared prototypes support zero-shot prediction and few-shot adaptation to unseen domains. Experiments on cardiovascular, ICU, and breast cancer benchmarks show generally competitive or improved performance over existing tabular methods, particularly when target-domain labels are scarce.
Critical strengths
The method brings together components that fit the problem well. Semantic embeddings help compare feature descriptions, graphs handle different numbers of features, and FGW considers both feature representations and their relationships.
The model can make predictions on a new domain without target labels or training a new input layer. This is useful for hospitals with limited labeled data.
The experiments cover three benchmarks with 16 domains, evaluating both learning across multiple sources and adaptation to unseen domains.
Critical weaknesses
My main concern is whether prototype matching keeps enough patient information for prediction. Two patients may differ in an important clinical feature but receive the same prototype weights, leading to the same prediction.
Also, the same clinical pattern may have different risks across hospitals because of differences in treatment, patient populations, or outcome definitions. It is unclear how well shared prototype predictions handle these differences.
The main tables compare full models, so it is hard to tell how much semantic embeddings, graph encoding, prototypes, and FGW matching each contribute to the gains.
Tables 2–3 report averages without standard deviations or confidence intervals. Although the experiments are repeated, these tables alone do not show whether the smaller improvements are reliable.
Questions for authors
See Weaknesses
5 comments
Response to Reviewer Gvbv (2/3)
W2. We agree that the same clinical pattern may carry different risks across hospitals. For each patient, REBASE computes coordinates that reflect both the hospital’s textual metadata (the name, description, data type, and unit of each variable) and the patient’s values, and uses them to combine the shared prototype predictions () into that patient’s risk. Differences between hospitals are therefore reflected in the coordinates, whereas the capture patterns that appear consistently across hospitals even when the hospitals record them differently.
First, REBASE represents each sample as a graph whose nodes are the features recorded by its source and whose edge attributes are derived from the features’ descriptors. Since the coordinates are computed from the FGW distances between this graph and each prototype graph, they reflect not only the patient’s values measured at each hospital but also how the hospital defines and records its variables. Figure 2 is consistent with this: for each source, we compute how strongly each basis is associated with positive outcomes (its coordinate-weighted positive rate) and compare these profiles across sources by cosine similarity. The profiles differ across sources; for instance, SUPPORT, which enrolled patients at advanced stages of one of nine illnesses rather than at intensive-care admission, shows the lowest similarity to every other source (at most 0.14; Section 5.2), likely reflecting its distinct patient population.
Second, within each basis, variables that record the same clinical quantity may differ across sources in name or definition, yet move together toward high-risk (Figure 3). For instance, in , the basis that appears to represent cardiorenal hypoperfusion, BUN in MIMIC-IV and urea in HiRID are defined differently, yet both are higher in the high-risk samples.
Thus, the bases shared across hospitals capture patterns that hold across sources, while differences between hospitals appear in the coordinates.
Response to Reviewer Gvbv (3/3)
W3. We have additionally conducted the suggested ablations.
Semantic embeddings [new]. Semantic embeddings place variables recorded under different names in a shared space where they can be compared. Since REBASE distinguishes variables only by these embeddings, without them two variables could correspond only if their names were identical. However, because each source follows its own naming conventions for the same underlying concept, most variables would then lose their counterparts in other sources: on the ICU benchmark, only 97 (24%) of the 398 cross-source pairs that record the same clinical feature share an identical name. This would break REBASE’s premise of learning jointly from sources with different schemas, so an ablation that removes only the semantic embeddings is not possible. Instead, we newly ran an ablation that progressively enriches the textual metadata in the descriptor given to the language model in three levels, thereby varying how much information about each variable the embeddings carry:
- L0: the column name alone
- L1: the column name with its clinical name
- L2: the full descriptor used by REBASE, with name, description, data type, and unit
As the metadata becomes richer, variables recorded under different names are matched more accurately (see our response to Reviewer r1Wt, Q2) and zero-shot AUROC on the ICU benchmark improves on average, with L0 the lowest in every source.
| Zero-shot AUROC (ICU) | MIMIC-IV | eICU | HiRID | SUPPORT | SICdb | Zigong | Mean |
|---|---|---|---|---|---|---|---|
| REBASE + L0 | 71.0±2.69 | 65.3±3.51 | 73.9±4.13 | 63.5±3.41 | 74.9±3.02 | 59.9±3.35 | 68.1 |
| REBASE + L1 | 72.5±4.51 | 67.9±3.24 | 80.5±5.65 | 65.0±5.99 | 76.3±4.99 | 60.6±5.91 | 70.5 |
| REBASE + L2 | 73.6±5.38 | 68.3±4.45 | 80.4±5.98 | 65.6±6.42 | 76.7±5.14 | 60.8±6.39 | 70.9 |
We have added these results to Appendix B.10 of the revised manuscript.
Graph encoding [new]. As with the semantic embeddings, an ablation that removes only graph encoding is not possible. Each sample is represented as an instance graph so that a single encoder can process sources with different variables; these graphs are aligned with the prototype graphs via FGW, and the prototype graphs are initialized from the encoder’s [CLS] embeddings, so removing graph encoding would also remove the FGW alignment and the prototype graphs. Meanwhile, self-attention over variables effectively operates on a fully connected graph, so replacing the encoder with self-attention would not remove the graph either. What graph encoding adds over self-attention is the edge attribute , which encodes the semantic relation between two variables, so we newly ablated only these attributes. As shown in the table below, removing them lowers the mean zero-shot AUROC on the ICU benchmark, so graph encoding not only underlies the FGW alignment and the prototype graphs but also improves zero-shot transfer through the semantic relations it encodes.
| Variant | Edge attributes | Zero-shot AUROC (ICU mean) |
|---|---|---|
| REBASE | ✓ | 70.9 |
| w/o edge attributes | ✗ | 67.5 |
We have added this ablation to Appendix B.6 of the revised manuscript.
Prototypes. Figures 5–6 (Appendix B.2) compare GAT trained on a single source, GAT trained on multiple sources without prototypes, and REBASE, showing that basis decomposition through prototypes improves performance. Basis exclusion (Appendix B.8) shows that removing a single basis lowers performance mainly in the sources that rely on it, indicating that each basis plays a distinct predictive role.
FGW matching. Figure 10 (Appendix B.6) shows that zero-shot AUROC on HD peaks at 78.0 with FGW (), compared with 64.7 when aligning on structure alone (GW, ). Tables 12–13 (Appendix B.7) show that replacing FGW with pooled [CLS] cosine or cross-attention alignment lowers zero-shot AUROC, averaged over the cardiovascular targets, from 76.8 to 61.2 and 55.9, and 64-shot AUROC from 89.7 to 81.1 and 80.0, at a comparable per-epoch cost (16.08 s vs. 13.94 s and 14.22 s).
W4. Tables 2–3 summarize few-shot results averaged over all target domains, so we do not report a single standard deviation there. Per-domain results with standard deviations are reported in Appendix E.4 (Cardiovascular), E.5 (ICU), and E.6 (Breast Cancer), and the statistical significance of the rank differences across methods is assessed with critical difference diagrams (Nemenyi test, α = 0.05) in Appendix E.2.
We hope this addresses your concerns.
Response to Reviewer Gvbv (1/3)
Thank you for your careful and constructive review. We especially appreciate your observation that predicting on a new domain without target labels or a new input layer is useful for hospitals with limited labeled data, which is the setting REBASE was designed for. Results from experiments newly conducted for this rebuttal are marked [new].
W1. We agree that this is a central question for prototype-based prediction. Our analyses indicate that the coordinates change with the clinical variables characterizing each basis. Patients who differ in such a variable therefore receive different coordinates, and since each prediction is the coordinate-weighted combination of the bases, they also receive different predictions. We examine this at the level of each basis (1) and of individual patients (2), and overall performance is consistent with it (3).
1. The variables characterizing each basis are clinically important. For each basis, we compare the samples assigned to it by their largest coordinate (high-risk) with the rest. The variables that separate the two groups are those used in established organ dysfunction and acute physiology scores; for instance, urea separates them for ϕ2 and prothrombin time for ϕ4 (Figure 3; Appendix D.2).
2. Among patients who are similar in all variables but the key variable, the coordinate changes with it [new]. To show this, we newly tested whether patients who are similar in all other variables but differ in one important variable receive different coordinates, in three steps.
In every case, the coordinate and the predicted risk rise with the key variable, whereas an unrelated variable, such as body temperature, shows almost no correlation with the coordinate (0.03–0.06). Patients assigned to the same basis therefore do not share one coordinate; it varies with the key variable, and so does the predicted risk. We have added this analysis to Appendix B.12 of the revised manuscript.
3. Overall performance. Expressing patients from all sources through the same prototype graphs does not cost predictive performance: REBASE outperforms both Single (GAT), which trains the same encoder on each source alone, and Multi (GAT), which trains it on all sources without the prototypes, at every sampling ratio on the cardiovascular benchmark (Appendix B.2).
[1] Gower JC. A general coefficient of similarity and some of its properties. Biometrics. 1971;27(4):857–871.