- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SLICE builds predictive models around structured single-feature perturbation behavior instead of attempting to summarize arbitrary perturbation curves after training. Its affine form constrains centered curves to a laminar family while retaining feature interactions. The paper characterizes the compatible functional form, develops differentiable parameterizations, and evaluates predictive performance and perturbation representations.
Critical strengths
-
The motivation is clear: ICE curves can be illegible, while averaging conceals heterogeneous responses. Constraining the predictor to have globally describable perturbation behavior directly addresses this tension.
-
Connecting that requirement to a functional characterization and trainable model constructions is a substantive methodological contribution. The experiments show that the resulting model class can retain useful interactions.
Critical weaknesses
-
Interaction-enabled baseline. Appendix C.1.3 disables EBM interactions, whereas A-SLICE includes pairwise interactions. An interaction-enabled EBM/GA2M under comparable tuning would better establish the accuracy-interpretability trade-off. This comparison does not affect the validity of the functional characterization.
-
Expressivity cost. Shared modulation functions restrict interaction shapes. A representative nonconforming pattern and its predictive cost would clarify when the structural guarantee is useful and when it is restrictive.
Questions for authors
- How does A-SLICE compare with an interaction-enabled EBM/GA2M under matched tuning?
- Which interaction patterns expose the main cost of the laminar restriction?
3 comments
Dear Reviewer jQaf,
Thank you again for your time and valuable suggestions. We wanted to briefly highlight a few additional revisions that further address your concerns regarding the comparison with interaction-aware EBMs.
Following further discussion, we have expanded Section 6.3 to explicitly discuss the predictive trade-off between A-SLICE and interaction-enabled EBMs. We acknowledge that EBM with all pairwise interactions achieves stronger performance on most real-world benchmarks, while highlighting the more competitive results against EBM (1x) and the complementary findings on the Feynman datasets.
We have also extended Appendix D.2 with native EBM explanations (Figure 14), including univariate shape functions and two-dimensional interaction plots. These help illustrate an important distinction between the models' explanatory objectives.
For an interaction-aware GAM, the complete perturbation effect of feature is
g_i(x_i)-g_i(c_i) +\sum_{j\neq i} \left[h_{ij}(x_i,x_j)-h_{ij}(c_i,x_j)\right].$$ Understanding this effect therefore requires combining its univariate shape function with all relevant pairwise interactions. For example, EBM (all pairs) on Bike Sharing contains 66 pairwise interaction functions, of which 11 involve any given feature. These are typically represented through two-dimensional plots. In contrast, A-SLICE represents the complete perturbation family as $$\Delta f_i^{c_i}(x_i,x_{-i}) = m_i(x_i)+\delta_i(x_{-i})w_i(x_i).$$ This enables a compact characterization of all possible perturbation curves through representative curves and globally valid bounds. While the structural restrictions underlying this representation can limit predictive flexibility, they provide a specific capability that the native GA\$^2\$M explanations do not directly offer. Finally, we have refined our wording throughout the manuscript to emphasize this specific objective rather than broader claims about interpretability. We hope these additions further strengthen the comparison you requested, and we would be very happy to address any remaining questions or concerns.Dear Reviewer jQaf,
We would like to share one further addition to the manuscript that directly addresses your concern regarding the predictive cost of A-SLICE's structural restrictions.
In our initial response, we provided a concrete example of a function that A-SLICE cannot represent exactly. We have now strengthened this analysis by deriving an exact, nonzero approximation gap, rather than demonstrating non-representability alone.
Actions taken
We have added Appendix E.3 with a new theoretical result. Specifically, we consider the smooth target function , where and are independent and uniformly distributed on .
We first prove that this function cannot be represented by A-SLICE, using a simple argument based directly on the structure of its perturbation curves. We then derive the exact minimum population MSE achievable by A-SLICE, showing that it equals , compared with for GAMs and for unrestricted models. These correspond to optimal values of , , and , respectively.
The result demonstrates that A-SLICE can recover half of the predictive improvement over an additive model while still incurring a strictly positive approximation error due to its structural constraints. Importantly, the result is established analytically, independently of model parameterization or optimization.
We believe this addition provides a more precise answer to your second question by identifying both a concrete interaction pattern that violates the A-SLICE constraints and the exact predictive cost of that restriction.
We hope that this new theoretical result, together with the interaction-aware benchmarks and expanded perturbation analyses presented in our earlier responses, addresses the main concerns raised in your review. Given these substantial additions, we would be grateful if you would consider revisiting your assessment and score in light of the revised manuscript. We would also welcome any further questions or clarification on concerns that remain unresolved.
Thank you again for your constructive feedback.
We thank the reviewer for their constructive assessment and for recognizing the motivation and methodological contributions of SLICE. We agree that stronger interaction-aware comparisons and a concrete illustration of the expressivity limitations would strengthen the paper. We have addressed both points in the revised manuscript, as detailed below.
Weakness 1
We agree that comparing A-SLICE only against additive EBM does not fully characterize the trade-off between predictive flexibility and perturbation structure. The original EBM configuration intentionally disabled interactions to serve as an additive baseline. However, we have now added two interaction-enabled EBM variants: one with up to p pairwise interactions and another with all (2p) possible pairwise interactions, where p is the number of features. Their results are reported in Tables 3–4.
These comparisons reveal a dataset-dependent trade-off. For example, on Churn, A-SLICE (spline) and EBM with all pairwise interactions achieve nearly identical ROC-AUC (0.925 versus 0.926). On Bike Sharing, interaction-enabled EBM achieves higher predictive performance (R2 of 0.926 versus 0.873). However, our new rank-order consistency analysis (Appendix D.3, Table 13) reveals substantial differences in perturbation structure: on Bike Sharing, A-SLICE achieves a consistency score of 1.000, compared with 0.748 for EBM with all pairwise interactions.
These results illustrate the distinction between interaction-capable models with and without guaranteed laminar perturbation families. We also provide centered ICE visualizations of the additional baselines (Appendix D.2, Figures 4–13), allowing direct qualitative comparison.
Regarding matched tuning, we acknowledge that the newly added EBM variants have not yet undergone hyperparameter optimization due to time constraints. Their results are therefore preliminary, and we plan to complete tuning for the camera-ready version.
Weakness 2
We agree that the shared modulation functions restrict the interaction patterns A-SLICE can represent. Although A-SLICE supports interactions of arbitrary order, all interactions involving a given feature must share the same univariate modulation function. This is a deliberate restriction that guarantees globally structured perturbation families, but it can also limit predictive expressivity.
To illustrate this limitation concretely, we have added an analytical example in Appendix E.2. Consider
f(x1,x2,x3)=x1x2+x12x3,
on [−1,1]3. This function contains two interactions involving x1, one with linear dependence on x1 and another with quadratic dependence.
For the reference value x1=0, the perturbation curves corresponding to contexts (x2,x3)=(0,0),(1,0),(0,1) are respectively 0, t, and t2. In A-SLICE, differences between any two perturbation curves for the same feature must be scalar multiples of a shared width function. Exact representation would therefore require t and t2 to be proportional, which is impossible. Hence, this function cannot be represented exactly by A-SLICE, even when higher-order interactions are permitted.
This example identifies a concrete interaction pattern excluded by the laminar restriction. The resulting predictive cost depends on the data distribution and is illustrated empirically by the performance differences between A-SLICE and the interaction-enabled baselines. We have also clarified this expressivity limitation in the discussion.
Actions taken
The revised manuscript includes the following changes, highlighted in blue in the updated PDF:
Interaction-aware benchmarks: Added two interaction-enabled EBM variants, CALM, shallow decision trees, and TabPFN-3.5 (Tables 3–4).
Perturbation analysis: Expanded the centered ICE visualizations (Figures 4–13) and introduced a quantitative rank-order consistency metric (Appendix D.3, Table 13).
Expressivity limitations: Added a concrete counterexample demonstrating an interaction pattern that A-SLICE cannot represent exactly (Appendix E.2).
Note on preliminary results. The newly added baselines (except decision trees) remain untuned, and some Table 13 results are based on a single fold rather than the full five-fold evaluation. We plan to complete these evaluations for the camera-ready version.
We thank the reviewer again for their thoughtful and constructive feedback. We believe the additional interaction-aware benchmarks and explicit expressivity example substantially strengthen the paper by clarifying both the benefits and limitations of enforcing structured perturbation behavior. We hope these revisions address the reviewer's concerns and welcome any further questions.