- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces TabLLE, a tabular in-context learning model that generates a query-specific affine classifier conditioned on a labeled support set. Each class logit is decomposed exactly into feature contributions and a bias term. A three-term training objective combines full-prediction supervision, feature-only supervision, and bias regularization to discourage predictive shortcuts through the bias. The paper evaluates prediction on 20 OpenML datasets, studies the discrepancy between frozen-parameter contributions and changes under feature masking, and introduces an auxiliary behavioral head to approximate the latter. It also reports faster inference than TabICLv2 under matched local-support configurations. The intended contribution is to combine competitive tabular prediction with native, inexpensive local explanations.
Critical strengths
-
A useful architectural direction with competitive predictive results. Generating support-conditioned affine outputs makes the final logit decomposition directly available during inference. The evaluation covers 20 classification datasets and a broad range of predictive baselines; the reported AUC IQM of 0.916 is competitive with the tree ensembles in Table 1. This makes the architecture worth investigating as a way to combine tabular in-context learning with explicit prediction decompositions.
-
The paper exposes an important limitation of its own explanations. The parameter-drift analysis distinguishes frozen-parameter contributions from actual changes after re-inference. Reporting a median drift ratio of 1.42 and the weaker native attribution results is informative. This analysis identifies a substantive problem for query-dependent linear explanations, even though the proposed remedy does not yet establish the native explanations' faithfulness.
Critical weaknesses
-
The native explanations perform substantially worse than LIME and SHAP on attribution faithfulness.
-
The attribution results show large gaps from standard explainers. Table 2 reports native Faithfulness of 0.263, compared with 0.516 for LIME, 0.678 for SHAP, and 0.687 for Kernel SHAP. Native Infidelity is also worse: 7.343 versus 4.525, 4.211, and 4.210, respectively. These metrics assess whether attributions reflect actual output changes under perturbation, a central requirement for explaining model behavior. Although the authors acknowledge parameter drift and limitations of masking-based evaluation, exact logit decomposition does not resolve the observed discrepancy. These gaps substantially weaken the paper's interpretability contribution.
-
The behavioral head only partially addresses this concern. Its Faithfulness improves to 0.599, exceeding LIME but remaining below SHAP and Kernel SHAP, while its Infidelity of 4.198 is comparable to both SHAP variants. These results concern a separate explainer trained on masking effects and do not validate the native coefficients used in prediction. The improved auxiliary output therefore does not establish the quality of the method's claimed native explanations.
-
-
The paper does not establish an efficiency benefit over LIME that offsets the loss in native explanation quality.
- The native explanations fall behind LIME on Faithfulness and Infidelity in Table 2, but the paper provides no runtime comparison with LIME. The 1.50x-5.15x speedups in Table 3 compare prediction against TabICLv2, not explanation against LIME. Although native attributions require no additional perturbation passes, the practical time savings are not quantified. The paper therefore does not demonstrate that the loss in attribution quality is offset by a meaningful computational advantage, limiting its contribution as an explanation tool.
Questions for authors
-
How does TabLLE differ from GAMformer and LFR-IMN? Please compare TabLLE with GAMformer (Mueller et al., 2026) and LFR-IMN (Hammer et al., 2026) in architecture, training objective, and explanation definition. Please add a comparison of predictive performance and explanation quality with GAMformer, and a local-fidelity regularization control for the proposed objective.
-
Why do the native attributions perform worse than LIME and SHAP? Please explain the large gaps between native TabLLE and LIME/SHAP in Table 2 and report uncertainty for these comparisons. Please provide evidence that the native attributions faithfully reflect model behavior, separately from the behavioral head's results.
-
How were the standard deviations calculated, and were the low TabR accuracies checked? Appendix H describes standard deviations over 25 folds, but Table 10 reports Iris accuracy of 0.956 +/- 0.003. With 150 samples and five-fold testing, the minimum population standard deviation across 25 folds consistent with that mean is approximately 0.0155. Please provide the fold-level results and clarify whether the tables report standard deviations, standard errors, or variation across repeat-level averages. Please also explain TabR's accuracies of 0.339 on Iris and 0.323 on Wine, including whether training or implementation failures were checked.
-
How does TabLLE's explanation efficiency compare with LIME? Please compare the explanation runtime of native TabLLE and the behavioral head with LIME under the evaluation protocol of Table 2. Report attribution quality alongside runtime, and specify the hardware and LIME sampling budget.