- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper is situated in the literature on explainability for multimodel models, in particular models that take text and time series data as input. The outputs of explanation methods in this context are, according to the authors, often used to make claims about one modality dominating the other, e.g. text being more important than the numerical data. The authors propose methodology to directly make such a claim, including statistical inference. Therefore they combine ideas from feature importance and uncertainty quantification. The main finding is that even if all individual scores suggest that one domain is more important than another, it could be that not off scores are significantly different from zero, which would affect the claim.
Critical strengths
The question of whether feature importance scores allow a particular conclusion that is commonly made a particular literature is interesting.
Critical weaknesses
- The paper is difficult to read, even as someone who knows the XAI literature pretty well.
- The central finding (scores might be negative but not be statistically significant) is nice, but at the same time also kind of common knowledge, so I don't see yet that the finding justifiees acceptance at ICLR.
- I am not convinced yet by the methodological construction of the explainability method. It is well known that permutation approaches are not really meaningful when the goal is to learn something about the data / the model's behavior on realistic data, and mixing the observation with another real observation might similarly suffer from extrapolation. Why not directly use something like conditional/observational imputation, where we have theory that links the feature importance scores to something meaningful, for example, conditional independence?
Questions for authors
- Why do you choose the three members of your declared family? Why not something like observational/conditional value functions?