- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes “linear lobotomy,” a pipeline for investigating graph properties encoded in GNN representations. It combines linear probing, concept erasure with random controls, and retraining of the downstream classifier. These stages distinguish decodability, dependence of the frozen classifier on erased information, and recovery of task performance. Properties outside a predefined task-specific expert vocabulary that pass the probing and erasure tests are classified as alien graph representations, with a check for linear proxies of expert properties. Experiments cover a synthetic motif benchmark, molecular and social graph classification, and two functional-connectivity tasks. The principal findings concern sensitivity to the erasure operator, differences in recovery between GCN and GIN configurations, and candidate unexpected structural properties.
Critical strengths
A useful empirical audit of representation-intervention methods on GNN embeddings. The paper compares three erasure operators and reports residual decodability, the number of removed dimensions, random controls, and recovery behavior across several tasks. The comparison shows that erasure operators achieving similar residual linear decodability can produce substantially different accuracy drops, illustrating why raw drops alone are insufficient for interpreting an intervention. The recovery-budget example likewise shows how premature stopping can produce misleading conclusions about recoverability. These observations identify practical failure modes in interpreting GNN representations and are the main reason I find the paper informative. The explicit reporting of failed robustness controls and inconclusive clinical results is also valuable.
Critical weaknesses
The erasure test does not establish property-specific use.
A property passes the paper’s “used” criterion when its erasure reduces accuracy more than random ablations of the same dimension. However, the reported used AGRs lack convincing support from the variance-matched control: no margin on any dataset reaches (Sec. 4.4). This leaves unresolved whether the intervention removes information specific to the named property or simply disrupts important directions in the embedding. Matching the number of removed dimensions does not ensure comparable disruption, particularly when the representation is anisotropic and the graph properties are highly correlated. The results therefore provide evidence of sensitivity to the intervention, but do not establish the property-specific dependence claimed in Sec. 5.
The fMRI results make this ambiguity particularly clear. LEACE already makes the property linearly undecodable and produces almost no accuracy loss. The candidate effects appear only under INLP, which removes approximately seven to nine directions. The additional damage could therefore arise from removing other useful information rather than from more complete removal of the target property. A small fraction of deleted dimensions does not establish selectivity. Moreover, no clinical effect survives Holm correction, and two ASD properties clear the dimension-matched control despite failing the held-out linear-decodability criterion. These findings weaken the interpretation of the Strong test as identifying properties the classifier uses. Since this is the key test supporting the alien findings, the claim that the model “provably depends on” the identified properties is stronger than the evidence warrants.
The analysis does not adequately distinguish alien information from overlapping expert cues.
The paper acknowledges that its property dictionary is highly collinear and excludes an alien property when a linear model predicts it from the expert set with held-out . This is a useful safeguard, but it does not establish that an erasure isolates information beyond the expert cues. A property can escape this flag while sharing task-relevant information with an expert property.
On Grid-House, the cycle rank determines the label exactly. Although the paper correctly excludes cycle rank as an proxy, it counts edge count, node count and density among the alien properties used by GIN with weight decay. Erasing count-related directions could disrupt the expert-equivalent cycle cue, and the reported drops do not distinguish this explanation from reliance on additional alien information. The algebraic relationship does not prove that the individual counts are expert proxies, but it leaves the attribution unresolved.
On MUTAG, the statement that the model relies on branching and size “rather than ring counts” is also too strong: erasing ring counts still reduces accuracy by 10.5 percentage points. Larger drops for other properties do not establish distinct reliance when the erased information overlaps, as the paper’s own Limitations paragraph notes (“the -proxy flag, not the size of a drop, carries the attribution”). The expert vocabulary itself also needs stronger justification: Sec. 4.3 states that the expert vocabulary for mutagenicity is ring structure without citing a source, and Sec. 1 reports expert validation only for the clinical sets. Consequently, the paper’s “clearest” alien case remains dependent on both uncertain attribution and an insufficiently validated expert vocabulary.
Questions for authors
Q1. The dimension-matched and variance-matched controls lead to different conclusions. Sec. 4.4 attributes this to how the random directions are drawn; could you explain the disagreement more fully and report both margins for every property counted as used? An additional control could fit the same erasure operator to repeatedly shuffled training-property values, while accounting for differences in the number of removed directions and representation distortion. Which used-property verdicts remain supported under comparably disruptive controls?
Q2. What evidence distinguishes reliance on an alien property from disruption of overlapping expert information? On Grid-House, this concerns edge count, node count and density versus cycle rank; on MUTAG, it concerns branching and size descriptors versus ring counts. Comparing joint erasure of the expert properties with joint erasure of expert and alien properties could be informative, provided the additional damage is appropriately controlled and shared information is considered when interpreting a negative result. Please also justify the MUTAG expert set and explain whether plausible alternative expert sets change the main AGR verdicts.
Q3. Could you distinguish recovery of label accuracy from recoverability of the erased property, for example by evaluating held-out nonlinear prediction of that property after erasure? Please also clarify whether the Grid-House results use one trained encoder checkpoint per configuration, with five seeds only for subsequent analyses. Given the differences in depth, width, pooling and classifier heads, what supports attributing the GCN/GIN contrast specifically to aggregation? In particular, does “GIN’s sum readout” in Sec. 4.1 mean neighborhood sum aggregation, since Sec. 3 specifies mean graph pooling?
Q4. What changed between the original and corrected runs? Please distinguish which choices, including expert sets, thresholds and the use of INLP for the fMRI interpretation were fixed before the initial results, and which were revised after inspecting earlier results. This would clarify which findings are exploratory and which evaluate choices fixed independently of those findings.