- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a tabular foundation model that jointly produces predictions and Shapley attributions in a single forward pass. The key idea is to generate attribution supervision from prior-sampled response functions, avoiding expensive surrogate fitting or repeated model evaluations. The model is evaluated on both synthetic and real-world datasets.
Critical strengths
-
Integrating Shapley attribution into model prediction is novel. The proposed supervision strategy enables efficient joint prediction and explanation without substential additional cost of explanation estimation at inference time.
-
The experiments are relatively comprehensive. The results demonstrate improvements in explanation efficiency while maintaining competitive predictive performance.
Critical weaknesses
-
The impact of joint prediction and attribution is insufficiently evaluated. Since XPFN integrates attribution directly into the prediction process, its impact on prediction efficiency and accuracy should be examined in detail. The paper lacks a direct comparison of efficiency and performance with a prediction-only backbone. Moreover, the loss-weight ablation suggests a trade-off between predictive performance and attribution quality, but this is not sufficiently discussed.
-
The reliability of the approximated attributions lacks guarantees. Although XPFN substantially improves explanation efficiency, the reliability of attribution is always more important in explainable AI. The theoretical result only characterizes the ideal minimizer of the training objective, without guaranteeing that learned attributions faithfully explain the model's own predictions or match their exact Shapley values. The approximation errors for explanation reliability need further investigation.
-
XPFN is designed specifically for interventional Shapley values with a context-based background distribution. It is unclear whether the framework can support other Shapley formulations or background distributions. The paper should better clarify its applicability and limitations.
Questions for authors
-
How does incorporating attribution affect prediction accuracy and inference efficiency compared with a prediction-only model?
-
To what extent can XPFN guarantee attribution fidelity and preserve the theoretical properties of Shapley values beyond the ideal optimization setting?
2 comments
Thank you for the authors' responses, which partially address my concerns. However, the results don't sufficiently characterize predictive accuracy and attribution reliability across datasets. It remains unclear how severely predictive accuracy can degrade due to joint learning and how large the attribution errors can be in the worst cases. Or are these drops hidden by aggregated results? Therefore, I maintain my original assessment.
Response to Reviewer Go6a
We thank the reviewer for the positive comments and the constructive questions.
W1 and Q1, accuracy. Following the reviewer's suggestion, we trained a prediction-only counterpart of XPFN-6.2M, the model of our supervision ablation, with the same prior, architecture, optimizer, schedule and 720k tasks, differing only in that the attribution losses are removed. It reaches a median Real-40 R² of 0.646, against 0.625 for the joint model XPFN-6.2M. Paired by dataset, the prediction-only model is better on 21 of 39 datasets with a median difference of only 0.002, and a Wilcoxon signed-rank test finds no significant difference (p = 0.57). At earlier checkpoints during the training, from 100k to 600k tasks, the joint model was ahead, significantly so at 400k and 600k tasks (p = 0.02 and 0.03). Incorporating attribution therefore does not consistently reduce predictive accuracy in this controlled comparison. We report this finding in Section 4.5.
W1 and Q1, inference efficiency. One forward pass of our model returns the prediction and all attributions, because the prediction is the base value plus the sum of the attributions. The prediction-only model in our experiment uses the same network, so it has the same inference cost. Compared to a single-output readout for regression only, the two output heads contribute 3.0% of the total parameters. We added this point to Section 4.4.
W1, loss weight. We rewrote the paragraph on the loss weight and moved its table to the main text (Table 5). The weight λ moves a fixed total weight between the coalition and the prediction term. At λ = 2 the prediction term is removed, and the Real-40 R² falls from 0.659 at λ = 0 to 0.601 while the self-fidelity rises from 0.809 to 0.863. The trend is not monotone, as λ = 0.5 reaches the highest R² of 0.663 with a higher self-fidelity than λ = 0 and λ = 1.25 is better than λ = 1 on all four metrics. Each setting was trained once, and λ = 1 was our default. Note that λ = 0 is not a prediction-only model, because all seven models also keep the base loss and the auxiliary attribution loss. The cost of attribution is therefore measured by the prediction-only control above.
W2 and Q2. Every Shapley axiom is a property of the exact values, so a learned estimator satisfies each of them within the error with which it approximates those values. We measured this error. On XAI-Bench we computed the exact Shapley values of XPFN's own predictions by evaluating every feature coalition. The direct attributions agree with these exact values at r = 0.978 and 0.980 for 5 and 10 features (NRMSE 0.149 and 0.155), between 0.975 and 0.982 across feature correlations of 0, 0.5 and 0.9, and between 0.979 and 0.990 across context sizes from 64 to 512 rows. On Real-40 the agreement with KernelSHAP on XPFN's own predictions is r = 0.913 (Table 3). Efficiency holds exactly by construction, and symmetry and the null-player property hold within the measured error. For a finite network there is no guarantee beyond the ideal minimizer, and the new Proposition 2 states what holds in that case. We added these results to Table 1 and Appendix C.2.
W3. XPFN implements interventional Shapley values with the context rows as background. Any value function that can be computed by querying the response function, for example a single baseline row or a background set chosen separately from the context, can supply exact labels in the same way. Conditional Shapley values would need conditional samples that our structural causal model does not provide in closed form. Only the interventional version is trained and tested, and we added a scope paragraph to the conclusion to clarify this.
We hope these revisions address the reviewer's concerns, and we would be grateful if the reviewer would consider raising the score.