- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies generalization of TCR–pMHC binding prediction under distribution shifts (unseen peptides, unseen TCRs, and jointly unseen peptide–TCR pairs). The proposed framework, HATIS, consists of two components: Hierarchical Atomistic Graph Transfer and Interface-Aware Stable Learning (IASL). The authors construct a unified benchmark with cluster-level hold-outs (MMseqs2, 0.4 identity, 0.7 coverage) covering peptide-only, TCR-only, and joint shifts, plus an external test set (TCRCube). HATIS reportedly improves AUPR over the strongest baseline by 12.86–13.98 percentage points under peptide-only and joint shifts, by 4.65 points on the external test set, and remains competitive under TCR-only shifts.
Critical strengths
- Well-motivated problem and a benchmark of independent value. Unifying peptide-only, TCR-only, and joint shifts in one task with cluster-level hold-outs (0.4 sequence identity) plus an external test set with experimentally supplied labels is more systematic than the protocols of TChar, TITAN, EPACT, or PISTE. The benchmark itself is a contribution the community can build on even independent of the method.
- A sensible and empirically supported strategy for alleviating triplet-data scarcity. Lower-order supervision is orders of magnitude richer than triplet data (1.35M peptide monomers, 341K pMHC binding pairs, 170K affinity records), and the ablations show that removing all pretraining degrades performance substantially (external AUPR 26.39 → 17.15), with pMHC transfer being the most critical stage. The narrative and the data agree here.
- IASL is a non-trivial adaptation of stable learning. The observation that not all inter-cluster dependencies are spurious. And the use of molecular composition to differentiate dependence penalties is a natural but previously unexplored way to inject domain structure into StableNet/StableGNN-style reweighting. The interface gate is inexpensive and remains active at inference.
- Rich analytical experiments. The representation-geometry probes (neighborhood gap, silhouette, centroid and kNN transfer AUROC) mechanistically support the claim that peptide shifts are harder and that HATIS preserves more transferable binding-class structure. Appendix F.1 partially controls for data-access fairness (EPACT + binding), and sensitivity analyses over λ_w and K are provided.
- Good reproducibility. Anonymized code and the benchmark are submitted; data sources, hyperparameters, software/hardware environment, and proofs are documented in detail.
Critical weaknesses
1."Atomistic" and "interface-aware" framing overstates what the model does, which is a central concern for this domain. The inputs are 2D covalent graphs built from sequences by RDKit; there are no 3D coordinates, no PDB/AlphaFold structures, and no geometric information of any kind (Appendix E.2: "Structure supervision is disabled"). A covalent graph is essentially an enriched sequence representation and carries no spatial information beyond the sequence. More importantly, the "interface score" is merely the balance of DiffPool assignment mass across the two molecules, and it is never validated against actual contact atoms/residues in solved or predicted TCR–pMHC complexes. The field's core bottleneck is precisely the lack of ternary structural data; this work sidesteps rather than addresses it, and no structure-aware method is included among the baselines. The title and framing risk misleading readers about the nature of the contribution.
-
The theoretical analysis provides almost no generalization guarantee. Theorem 1's recombination distribution Q_comp is an analytical construction that, by the authors' own statement, need not coincide with the target distribution; the comparison J_T ≤ J_unif follows trivially from 0 ≤ T ≤ 1, and the "strictly smaller" claim is an immediate consequence of the definitions. The result is motivational at best; presenting it as "theoretical analysis" inflates its weight.
-
Ablation results contradict the design narrative. (a) Removing pTCR transfer improves peptide-only and joint-shift performance (AUPR 46.99 vs 46.07; 46.53 vs 44.54), one branch of the three-stage design is a net negative on th headline settings, yet the Full model retains it, and only a qualitative explanation is offered. (b) Removing IASL entirely (II+III) also improves TCR-only AUPR over Full (66.79 vs 66.24). (c) Under TCR-only shifts, HATIS trails EPACT by 5.08 AUPR points, so "remaining competitive" is an optimistic characterization.
-
Residual fairness concerns in baseline comparison. In the main table, HATIS exclusively uses large auxiliary corpora (monomer data, affinity, pTCR binding); the Appendix F.1 control augments only EPACT. UniPMT (Nat. Mach. Intell. 2025) is cited in the related work but not included as a baseline, and deepAntigen (Nat. Commun. 2025), an atom-level graph method and one of this paper's data sources, is also missing. In addition, the pTCR corpus covers only 676 peptides (vs 124K TCRs), an extreme imbalance that may itself explain the negative transfer, but no diagnosis is provided.
-
Internal negatives are randomly recombined "unobserved combinations," not experimentally confirmed non-binders. With 5:1 recombination that explicitly does not preserve pMHC pairing, some negatives are likely false; the external set mitigates this for one setting, but absolute metric values on the three internal settings should be interpreted with caution.
-
No unseen-MHC evaluation. The triplet training pool contains only 33 MHCs and 321 peptides, peptide diversity in training is itself extremely low. The practically important scenario of novel/rare patient alleles is not evaluated, even though the MHC sequence representation would in principle support it.
Questions for authors
- Structural validation: Have you checked whether the learned cross-molecular (top-k) edges or high-interface-score clusters correspond to actual contact atoms/residues in solved TCR–pMHC complexes (PDB) or AlphaFold-predicted structures? Appendix E.2 mentions "Structure supervision is disabled," implying the code supports it. What happens when it is enabled, and why is it not used?
- Interpretability of the interface gate: Do interface scores correlate with known functional regions (e.g., CDR loops, pMHC contact zones)? Could you provide 1–2 case studies to justify the "interface-aware" naming?
- Model selection: Given that pTCR transfer is a net negative on the headline settings, why is the Full model the default? What is the basis for reporting Full rather than w/o pTCR transfer in the main table? Were all configurations (including K = 8) selected on the validation split or the test split? Please state the selection protocol explicitly to rule out test-set peeking.
- Disentangling IASL's gains: Could you add an ablation with uniform penalties (reducing to StableGNN-style reweighting) plus the interface gate, to separate how much of the gain comes from composition weighting T, from reweighting itself, and from the gate?
- Negative-sample quality: What is the estimated false-negative rate in the recombined negatives? Have you tried calibration or fine-tuning using the experimentally validated negative labels in the external set?
- Unseen MHC: Why is there no unseen-MHC evaluation? How does the model perform on novel alleles given that the training pool contains only 33 MHCs?
- Missing baselines: Why are UniPMT and deepAntigen not compared against? The latter is an atom-level graph method and one of your data sources, so the comparison should be nearly free.
- Effect of training coverage: With only 321 training peptides, how much of the peptide-only-shift improvement compensates for the tiny training peptide pool versus reflecting genuinely transferable mechanisms? Could you report performance stratified by training-peptide frequency?
9 comments
Response to Reviewer Q1u2 (2/8)
W2: Scope of the analysis
We agree that and its strictness conditions follow directly from the definitions. However, the ordering of the bounds and the validity of the weighted risk bound are separate questions. The proof first controls the risk difference through , then uses under the composition-guided recombination mechanism to obtain the bound involving . Thus, arbitrary weights in cannot simply replace and retain the same guarantee. The analysis therefore links composition-weighted dependence to a specified risk difference, beyond comparing two penalty values. We acknowledge that this mechanism is an analytical construction and does not provide a guarantee for the actual target distribution. To reflect this scope, we have removed the “Theorem 1” heading in the revision and presented the result under “A supporting analysis of composition-guided recombination”, with practical benefits assessed through empirical comparisons.
Response to Reviewer Q1u2 (3/8)
W3 & Q3: Ablation trade-offs and the choice of the Full model
pTCR transfer and the Full model. Given limited triplet supervision, we use both pMHC and pTCR data to provide lower-order interaction knowledge and report this complete hierarchical framework as the Full configuration. Table 2(A) shows that the benefit of pTCR transfer depends on the evaluation setting: removing it improves peptide-only and joint-shift AUPR by 0.92 and 1.99 percentage points, respectively, but lowers external AUPR from 26.39% to 24.51%. Thus, the branch has a design rationale in providing additional interaction supervision, and its value is supported by the external result. Reporting Full evaluates the complete framework across settings. We also report the variant without pTCR transfer to make this trade-off explicit.
IASL. The ablations already reported in Table 2(B) remove IASL from both pairwise and triplet training to assess its overall contribution. Table 2(B) shows a 0.55-point increase in TCR-only AUPR, alongside decreases of 0.42, 2.09, and 4.29 points under peptide-only shift, joint shift, and external testing, respectively. These results support IASL's contribution primarily to generalization involving unseen peptides, especially in the joint and external settings, while showing that its benefits vary with the type of shift.
TCR-only performance. HATIS achieves 92.34% AUROC, close to EPACT’s 93.14%, while its AUPR is 5.08 percentage points lower. Our description of “remaining competitive” reflects the comparable AUROC, rather than superiority across both metrics. We acknowledge EPACT’s stronger AUPR in this setting. HATIS’s main performance advantages are under peptide-only and joint shifts and on the external test set.
Configuration choice (Q3). The Full architecture and the default were fixed in advance, rather than selected based on test-set performance. Here, denotes the final number of DiffPool clusters. Checkpoints were selected based on validation loss.
Response to Reviewer Q1u2 (1/8)
We thank the reviewer for the constructive comments.
W1 & Q1–Q2: Atomistic representation, interface scores, and structural supervision
Meaning of “atomistic.” We acknowledge that “atomistic” can suggest three-dimensional modeling in some contexts. Here, it refers to the resolution of our representation and computation: we construct atom–bond graphs from sequences, explicitly encoding atom attributes, chemical bonds, and intra-residue topology. These graphs contain no three-dimensional coordinates. This terminology has precedent: deepAntigen (Nat. Commun. 2025) [1] describes atomic-level modeling and includes a sequence-based prediction branch built on atom graphs. We therefore consider atom-level modeling an appropriate description, while agreeing that its distinction from geometric modeling should be explicit.
Meaning and interpretation of “interface-aware” (Q2). The interface score measures the balance of DiffPool assignment mass from the two interacting components within a cluster; at the triplet stage, these are pMHC and TCR. It describes cross-component mixing, rather than physical contact probability. Composition balance guides readout weighting, while differences between cluster compositions modulate HSIC regularization. The motivation is to reduce training-specific co-occurrence dependencies between interaction patterns with different molecular compositions; larger composition differences therefore receive stronger decorrelation penalties.
This is the intended meaning of “interface-aware” in our aggregation and stable-learning design. We do not claim that high-scoring clusters recover physical interfaces or identify functional regions such as CDR loops.
Why structure supervision is disabled (Q1). We agree that the scarcity of experimental ternary structures is an important bottleneck. The code includes an optional structure-supervision module to support future fine-tuning with predicted or experimentally determined crystal structures. This module is disabled in the model reported in this paper, as stated in Appendix E.2. Incorporating such structural supervision into the sequence-input binding prediction framework is a direction for future work.
Application scope and structure-aware comparisons. Our target applications include personalized neoantigen screening and antigen-specific TCR screening: identifying potentially recognized combinations from candidate peptides, patient MHCs, and TCR repertoires. These applications typically provide sequences before corresponding complex structures are available. Some datasets contain only TCR CDR3 sequences, without complete variable regions or paired chains. Predicting a complete TCR–pMHC structure from such records generally requires additional sequence information or reconstruction of the missing regions.
Our comparisons therefore focus on binding prediction without complex-structure inputs. Effectively incorporating experimental or predicted geometry, and converting it into reliable improvements in triplet binding prediction, remains an important direction for future work.
References
[1] Que, J., et al. Identifying T cell antigen at the atomic level with graph convolutional network. Nat. Commun. 2025, 16, 5171. DOI: 10.1038/s41467-025-60461-6.