- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies the context dependence of tabular foundation models (TFMs). It examines two aspects: prediction spread, measured as the standard deviation of predictions across different contexts, and the influence of a single context row on the prediction. The authors evaluate several TFMs, including Mitra, PFNs, TabICL, and TabFM.
Critical strengths
None
Critical weaknesses
The paper present something in a useful direction, but the contribution feels somewhat limited in its current form, since it largely consists of empirical checks of the results in Nagler (2023). It would help if the authors clarified what new insights the work offers beyond this prior study. As it stands, I am not yet convinced the paper meets the bar for ICLR.
My main concern is the clarity of the writing. The paper is currently quite difficult to follow, which makes it hard to properly assess the central claims. For example (one of several such instances), “higgs” and “magic” are introduced without explanation, so the reader can’t tell whether they are datasets or something else. The paper also presents many specific numbers with little context, including in the abstract. Some of these details may fit better in the experiments section or the appendix, which would let the main narrative and claims come through more clearly. I believe the presentation needs a substantial revision before the paper is ready for submission, and I hope the authors find these comments helpful in strengthening it.
Reference:
Nagler, Thomas. "Statistical foundations of prior-data fitted networks." International Conference on Machine Learning. PMLR, 2023.
Questions for authors
None