- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
When you do a circuit analysis, one common type of ablation is a mean ablation on the complement of the circuit. The complement are things that are thought to not really matter in the circuit. This paper shows that they do and that you can miss important behaviors when you do it. For example, if you knock out a circuit component like a head and self-repair happens in some of the outside components, then you would have missed that because you did amine ablation on the outside components.
Critical strengths
I think this paper identifies an interesting problem with a protocol sometimes used in circuit analyses (the complement mean ablation) by connecting to prior work in the area (self-repair). Put another way, they point out and demonstrate the issue of doing mean ablations on the complement, because when you then try to get importance for the in-circuit components (through e.g., ablating them), you now fail to measure effects like self-repair, which can make up for that ablation.
Critical weaknesses
The exact contribution is a little specific and niche within the field. I think this paper has limited impact even if the observation is interesting and useful in limited applications
The attention sink rresult is interesting but I feel like it doesn't contribute much to the main story
I would be more willing to give a positive score if the paper contributed a concrete scientific finding that researchers would change after these experiments and establish cleaner results (e.g., the acronym result fails the arbitrarily chosen threshold, while the other two pass)
Questions for authors
N/A