- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies generalized functional ANOVA for dependent inputs. It proposes a density-weighted Legendre-polynomial basis and proves that it forms a Riesz basis, allowing a unique representation of the hierarchically orthogonal components. Based on the proposed approach, the authors introduce an estimator using truncated polynomial expansions and estimated marginal densities. Experiments on synthetic and real-world datasets study reconstruction accuracy and compare the estimated effects with existing explanation methods.
Critical strengths
Addressing the problem of efficiently estimating functional ANOVA decompositions in settings with dependent features is an interesting and relevant research direction.
Critical weaknesses
1. Limited novelty and insufficient discussion of related work. The main contribution in Section 3 is a density-weighted Legendre-polynomial basis for generalized functional ANOVA. However, polynomial-based decompositions for dependent inputs have already been studied by Rahman [1], while Chastaing et al. [2, 3] developed closely related theoretical and numerical approaches. It is not clear how the proposed approach differs from these methods or what additional benefits it provides. In particular, the significance of the Riesz-basis result relative to existing work is insufficiently explained. I therefore find it difficult to identify a substantial new contribution. I also find the theoretical presentation unclear. *Sections 1 and 2 do not clearly distinguish marginal effects, pure main effects, and interaction effects. The discussion of conditional-expectation-based decompositions is also imprecise: Möbius inversion remains valid under dependence, but generally does not yield hierarchically orthogonal components.
2. Inadequate experiments and missing relevant comparisons. The experiments in Section 5 mainly compare the proposed method with SHAP, TreeHFD, NAM, and EBM. I do not find these comparisons particularly meaningful without further justification, since these methods do not necessarily estimate the same quantities. In particular, SHAP attributions are not pure main effects. More importantly, comparisons with existing estimators of generalized functional ANOVA [1, 3] are missing. Related approaches such as interaction purification [4] and Random Planted Forests [5] should also be compared agains and discussed. The experiments focus almost entirely on main effects and pairwise interactions, which have already been studied extensively. I would expect experiments involving higher-order interactions and a more direct evaluation of the recovered component functions. Good reconstruction accuracy alone does not demonstrate that the individual effects are correctly estimated. Finally, Section 4 provides no statistical guarantees for the estimator, and the experiments do not systematically investigate the influence of polynomial truncation or marginal-density estimation. I also could not find a code repository for reproducing the results.
[1] Rahman (2014). A Generalized ANOVA Dimensional Decomposition for Dependent Probability Measures.
[2] Chastaing, Gamboa & Prieur (2012). Generalized Hoeffding–Sobol Decomposition for Dependent Variables—Application to Sensitivity Analysis.
[3] Chastaing, Gamboa & Prieur (2015). Generalized Sobol Sensitivity Indices for Dependent Variables: Numerical Methods.
[4] Lengerich et al. (2020). Purifying Interaction Effects with the Functional ANOVA: An Efficient Algorithm for Recovering Identifiable Additive Models.
[5] Hiabu, Mammen & Meyer (2020). Random Planted Forest: A Directly Interpretable Tree Ensemble.
Questions for authors
see weaknesses
Official Comment by Reviewer k9BE
Thank you for the detailed response; I have increased the score to 3.