- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Explainability From Training (EFT), which tracks feature importance across training checkpoints and clusters similar trajectories to summarize how model explanations evolve. It applies EFT to four TCR-epitope prediction models and introduces TCR-XAI2, which contains 388 experimentally resolved structures, 619 complex instances, and corresponding predicted structures. Through trajectory analysis and binding region hit rate, the authors investigate architectural differences, the role of MHC information in coordinating TCR /-chain evidence, and the effects of structural regularization.
Critical strengths
- Tracking explanations throughout training provides a useful perspective on changes that final-checkpoint analysis can miss.
- TCR-XAI2 provides a useful structural reference for evaluating residue-level explanations and comparing sources of structural supervision.
Critical weaknesses
- The evidence for / - chain learning conflict is indirect. Different or opposing BRHR trajectories do not establish that learning from one chain interfaces with learning from the other. In particular, the correlation of approximately 0.06 without MHC information in Fig. 5 indicates littele linear association, rather than antagonism. The proposed mechanism is plausible, but the evidence supports a narrower descriptive conclusion. Can the authors provide evidence beyond trajectory correlations that distinguishes interference from independent changes in structural alignment?
- The architectural conclusions are confounded by other differences. Models use different training datasets, input modalities, and attribution methods (Appendix A.5). Appendix A.7 also shows that changing the attribution method changes the explanations. Consequently, the reported CNN-Transformer differences cannot be confidently attributed to architecture, weakening the generality of a central finding. Which headline conclusions remain consistent across attribution methods, and are there comparisons controlling for training data and input modalities?
Questions for authors
Please see the questions included in Critical Weakness 1 and 2.
5 comments
Thank you for the additional experiments, which adequately address my second concern regarding the architecture comparisons. My remaining concern is that divergent BRHR and attention trajectories do not directly establish learning interference between the TCR chains, and increased peptide BRHR variability after freezing the TCR encoders does not necessarily demonstrate a transfer of learning pressure. Given the limited time for further experiments, I suggest tempering these claims throughout the manuscript and presenting these mechanisms as possible interpretations rather than established conclusions.
Thank you for your response. We agree with your suggestions and have tempered the corresponding claims in the revised manuscript, with the changes highlighted in purple.
Please let us know if you have any further suggestions or concerns.
Thank you for your constructive suggestions. Below are our responses to weaknesses described in the review.
W1. Direct evidence for the conflict between the TCR chains
To provide the direct evidence for the TCR conflicts, we have added an extra dedicated experiment in
Section 3.4. We train an encoder-only BERT model with separate encoders for the peptide, CDR3a, and CDR3b, whose concatenated representations are passed through a linear layer to predict the binding probability. The model is optimized with a binding prediction loss and a masked language modeling (MLM) loss on TCRvdb, a recently published and experimentally verified dataset. We compare three strategies: (1) "Vanilla", joint training of the full model throughout; (2) "Pair TCR", training only the CDR3a and CDR3b encoders with the MLM loss for the first 50 epochs before resuming joint training; and (3) "Pair TCR & Frozen", which uses the same first stage but then freezes the TCR encoders and trains only the peptide encoder. Even when the peptide branch is frozen, the BRHR and attention mass trajectories of the alpha and beta chains are already inconsistent. Once the peptide joins training, the attention mass of the two chains becomes substantially more inconsistent. When we instead freeze the TCR encoders to suppress this inconsistency, the variance of the peptide BRHR increases sharply, suggesting that the pressure shifts from TCR encoder learning to peptide encoder learning.W2. Controlling for confounds in the architecture comparison
For the interpretation method,
Appendix A.8compares TULIP-MHC interpreted with QCAI and with AttnLRP, and MixTCRpred interpreted with GradCAM and with AttnLRP. The explanations differ in minor respects, as each interpretation method targets different aspects of the model by design, but the overall pattern is unchanged. We also include an interpret-by-design model, TCR-SRIM, whose explanations are faithful to its predictions by construction.For the dataset, we additionally add extra experiments to train all models on TCRvdb so that the comparison uses common data with reduced label noise. As shown in
Appendix A.11, the resulting explanations are consistent with those obtained on the original training datasets.