- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TABERA, a tabular classification model that connects prediction and example-based explanation through a shared region structure. An encoder assigns each input to a learned centroid, and a linear head combines a regional baseline with an instance-specific correction. After training, examples are retrieved from the assigned region to contextualize the prediction, without participating in the predictive computation. Across 21 OpenML datasets and five splits, the paper reports competitive accuracy and F1 against 13 baselines, label-relevant regional structure, and faster prediction than TabR on 15 datasets. Two credit-classification examples illustrate the proposed explanation interface. The central question is whether this structural connection produces faithful explanations of the final prediction and offers an advantage over existing interpretable models.
Critical strengths
-
Clear architectural connection between prediction and explanatory context. The regional baseline explicitly participates in prediction, and the same region assignment determines the candidate examples. The exact logit decomposition makes this connection inspectable. Separating prediction from example retrieval also allows evidence to be requested without requiring training-instance lookup for every prediction.
-
Competitive reported predictive performance across multiple datasets. The evaluation covers 21 classification datasets, five splits, and a range of strong tree-based and neural baselines. The reported accuracy of 0.850 and F1 of 0.791 suggest that the regional architecture can retain useful predictive performance. The regional-label and retrieval-support analyses provide initial evidence that the learned groups are informative and usually contain enough examples for the proposed interface.
Critical weaknesses
-
The experiments do not establish that the explanations faithfully reflect the final predictions.
Sharing a region connects the retrieved examples to one component of the prediction, but does not establish that they explain the final decision. The displayed explanation does not explicitly account for the instance-specific correction. Section 6 acknowledges the absence of feature attribution and the dependence on region quality; nevertheless, the displayed regional characteristics have not been validated as evidence of what drives the model's output.
Section 5.1 measures regional accuracy, class agreement, and retrieval coverage. The reported 3.96% class-change rate supports agreement between regional and final predictions on most samples, but does not measure changes in probabilities or margins. Figure 3(b) also shows regional accuracy of approximately 22% and final accuracy of approximately 84% on OpenML 1493. This dataset appears to account for nearly all of the reported 2.99-point average improvement from the correction, yet the paper does not explain how its regional evidence accounts for the final decisions in this case.
The two examples in Section 5.3 illustrate the interface but do not validate its fidelity. No quantitative comparison with ordinary nearest neighbors or random same-region examples establishes the contribution of the proposed retrieval rule to explanation quality. The evidence therefore supports regional context, while the central contribution of explaining individual predictions remains insufficiently validated.
-
The comparison with existing interpretable models is insufficient.
TABERA trains its own classifier and provides an accompanying explanation mechanism. However, Section 4 compares predictive accuracy and F1, and Section 5.2 compares prediction speed with TabR; neither evaluates explanation quality against other interpretable models. Section 2.2 distinguishes TABERA from ProtoGate (Jiang et al., 2024), whose prototypes participate in prediction, but provides no experimental comparison. Interpretable tree, rule, and additive models are also absent from the explanation evaluation.
The reported point estimates broadly support the authors' claim of competitive prediction: TABERA matches LightGBM in accuracy, is slightly below ModernNCA, and ties ModernNCA and ResNet in F1. This is a useful result, but without measurements of explanation fidelity, stability, or complexity, it leaves the comparative contribution of the explainable architecture unclear. The current evaluation does not establish whether TABERA offers better explanations at comparable predictive performance or a better accuracy-interpretability trade-off.
Questions for authors
-
Where is the appendix referenced in the paper? Section 4.1 and the reproducibility statement refer to an appendix, but it is absent from the supplied PDF. Please provide the appendix and clarify whether it was submitted separately. Include the stated implementation details, hyperparameter ranges, and evaluation protocol.
-
Why does the correction produce such a large accuracy gain on OpenML 1493? Figure 3(b) shows an approximately 62-point accuracy gain from the correction on this dataset, which appears to account for nearly all of the average gain. Please confirm the values, explain this behavior, and report regional accuracy, final accuracy, and class-change rates for each dataset. Please clarify how the explanation accounts for the final decisions on OpenML 1493.
-
Where are TABERA's results in Table 1? Section 4.2 reports TABERA's accuracy of 0.850 and F1 of 0.791, but I could not find its experimental results in Table 1. Please provide the missing entry and the per-dataset results for TABERA and the baselines, including variability across the five splits.
-
Do the explanations faithfully reflect the final predictions? Please provide quantitative evidence that the retrieved examples and displayed regional characteristics reflect the final prediction, including the instance-specific correction. Please compare explanation fidelity with ordinary nearest-neighbor retrieval and random same-region selection, and state the fidelity measure used.
-
How does TABERA compare with existing interpretable models? Please compare TABERA with ProtoGate (Jiang et al., 2024) and representative interpretable tree or additive models on the same datasets. Report predictive performance and explanation quality using clearly defined measures, such as fidelity, stability, or complexity.