- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes to quantify the generalizability of interactions, where by interactions they mean the XAI technique to represent a model's behaviour via combinations of AND and OR operations. This approach is shown to yield insights into the training-time dynamics of CNNs and small Transformer models.
Critical strengths
The weakness described below makes it very hard for me to formulate a list of critical strengths.
Critical weaknesses
-
W1: The paper is extremely hard to follow, and it is very poorly structured. This is suggestive of heavy reliance of AI tools for writing purposes. For instance:
- The background is inserted in the middle of the Introduction, which makes everything hard to follow
- Some pieces of text are highlighted with a strange grey vertical bar, which is unusual and apparently useless
- The paper relies on a video demo to explain one key component of the proposed method, which, other than being unusual, is also detrimental to the flow of the paper, given also the poor quality of the video
- The main question highlighted in the Introduction feels detached from the abstract, and it is only later contextualized with it.
-
W2: Authors did not release the source code.
-
W3: The precise meaning of AND and OR interactions is never discussed, and their precise meaning remains ambiguous. Also, the procedure for extracting them is confined to the Appendix, despite being key to the paper.
-
W4: The authors say that an interaction is generalizable if the baseline DNN concurrently encodes the same AND interaction (line 242-243). I do not particularly agree as different DNNs may encode alternative interactions, and authors do not discuss how their approach handles them. Also, the two DNNs are trained on different data, hence the same interactions may not emerge due to different training regimes.
Questions for authors
N/A