- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether attention to reaction centers reflects causal importance in a retrosynthesis Transformer. Using head-level ablation on Chemformer, the authors find that heads strongly correlated with reaction centers have little impact on generation when removed, while most ablation damage is concentrated in the first encoder layer. They further identify non-additive interactions among attention heads and a correlation between attention entropy and head sufficiency.
Critical strengths
Understanding how retrosynthesis models represent and utilize reaction-center information is an important problem, given the extensive research on explicitly incorporating reaction centers into retrosynthesis prediction.
Critical weaknesses
-
Limited novelty and mechanistic insight. Although the paper presents extensive empirical analyses, I find the main observations largely consistent with existing understanding of Transformer behavior. The distinction between attention correlation and causal importance is already well established, and the redundancy and interactions among attention heads are not particularly surprising. More importantly, the analyses do not lead to a substantially new understanding of how the model actually performs retrosynthesis or utilizes chemical information. As a result, I find the contribution limited beyond confirming previously known interpretability concerns in a chemistry-specific setting.
-
Unclear connection between the observed phenomena and reaction-center information. The finding that the first encoder layer dominates ablation damage may simply reflect the general importance of early representations in Transformers, rather than anything specific to retrosynthesis. Similarly, the strong non-additivity of attention-head ablation could arise from generic redundancy and interactions among heads. These observations do not necessarily reveal any distinctive mechanism related to reaction centers. Consequently, it is unclear what additional conclusions about retrosynthesis or chemical reasoning can be drawn from these experiments.
-
The central claim appears overstated. The fact that ablating reaction-center-correlated attention heads causes little performance degradation does not establish that the model does not need reaction-center information. The model may still encode and utilize such information through other attention heads, layers, or implicit representations that the current analysis does not identify. In particular, the experiments intervene on attention heads rather than reaction-center information itself. Therefore, the results support a narrower conclusion—that attention correlation is not a reliable indicator of head-level causal necessity—rather than the stronger implication suggested by the title that reaction-center information is unnecessary for retrosynthesis prediction.
Questions for authors
-
What evidence supports the conclusion that reaction-center information is unnecessary, rather than being encoded and utilized through other components of the model?
-
To what extent are the first-layer dominance and non-additive head interactions specific to retrosynthesis, rather than general properties of Transformers?