- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose PIT-GCL which predicts whether two proteins interact using a shared per-protein encoder followed by pairwise fusion. For each protein, frozen ESM-2 residue embeddings are combined with a global persistent-homology descriptor computed from C-alpha coordinates. Four transformer layers optionally use intra-chain distance biases. Bidirectional cross-attention then fuses the independently encoded proteins, and training combines binary cross-entropy with NT-Xent. Evaluation is done on PPIRef, a constructed PPB-Affinity classification task, and STAG TCR–pMHC.
Critical strengths
-
The separation between cacheable single-protein encoding and lightweight pairwise fusion is easy to understand and has a plausible high-throughput benefit when done at scale.
-
The no-topology, zeroed-topology, shuffled-topology, no-distance-bias, and no-contrastive-loss controls make the empirical contribution of each proposed component clear. The shuffled control seems useful, although the zero-input arm is not a true functional-capacity match. The paper acknowledges that the distance-attention bias contributes no measurable gain.
-
The manuscript reports component-level timings and distinguishes first-time structural preprocessing from reuse of cached protein encodings.
-
Results span three interaction settings, and the appendix explicitly acknowledges bound-conformation dependence, synthetic negative artifacts, limited support for the attention machinery, and the lack of conformational-change stratification.
-
The full model's mean PPIRef performance is above the paper's ESM mean-pooling control, while topology removal causes a mean drop over the three reported seeds.
Critical weaknesses
-
All coordinates come from resolved complexes. PPIRef inputs are interface fragments extracted with a 6 Å contact rule from the known bound complex, with a median length of only 24 residues. At screening time the binding interface is unknown, so this preprocessing is an oracle that might be unavailable for novel candidate pairs. The paper itself notes this limitation in Appendix A, but still motivates the method as a practical alternative to pairwise cofolding. The architectural fact that each protein is encoded independently does not resolve this mismatch: the input fragments and conformations were selected using the holo complex.
-
PPIRef negatives are created by randomly re-pairing chains from different complexes. These are not verified non-interactors: absence from the same deposited complex does not imply non-binding. A logistic regression on five chain-length features reaches AUC 0.8138, and a simple pair persistence descriptor reaches 0.7905. Then much of the benchmark is predictable from construction cues rather than demonstrated physical non-interaction. The length-matched negative analysis is helpful but incomplete. The paper does not retrain and compare all baselines, topology ablations, or simple geometry controls under this harder distribution. Comparing 0.8863 on hard negatives against baseline numbers measured on the easier test distribution does not establish relative superiority.
-
The manuscript describes seeded 80/10/10 splits of PPIRef cluster representatives but does not establish protein, chain, PDB, complex, or sequence-disjointness. The same or closely related proteins may therefore occur across train and test in different complexes. It is also unclear whether negative re-pairing is performed strictly within each split and whether a chain used in a training negative can appear in a test pair.
-
Binary protein interaction is invariant to swapping the two inputs, but the model uses side-specific cross-attention projections and concatenates the pooled A and B representations in an ordered way. No architectural invariance, bidirectional averaging, augmentation with both orders, or swap-sensitivity test is reported.
-
The strongest general PPI sequence baselines are relatively old, while PIT-GCL benefits from ESM-2. The paper's ESM mean-pooling MLP is valuable, but it is described as untuned, is not run on PPB-Affinity or STAG, and stronger modern PLM pair classifiers and matched pair-fusion baselines are needed.
-
The paired bootstrap uses predictions from one seed and resamples test rows. It therefore ignores split/training variability and likely treats examples sharing proteins as independent. The very small reported p-values should not be interpreted as uncertainty for the full training-and-data procedure.
Questions for authors
-
How much does the score change under input reversal? Please report
f(A,B)versusf(B,A)and the result of symmetrized inference or training. -
What exact entities are disjoint across PPIRef train, validation, and test? Please report chain/protein/PDB/complex/sequence overlap and explain whether all negative sampling happens strictly within each split.
-
Can all principal baselines and component ablations be trained and evaluated on the length-matched negatives, ideally alongside curated non-interactors or physically plausible decoys?
-
What performance remains when inputs are full independently predicted or experimentally determined unbound monomers, without using an oracle interface from the bound complex?
-
How does persistent homology compare with parameter-matched simple global geometry descriptors under both easy and hard negative construction?
2 comments
Re:Review2
The TCR-pMHC fold re-uses training structures and (TCR β, peptide) pairs: on the 2,402 rows where neither appears, the margin reverses to −0.0221 [−0.0399, −0.0043], and rank-averaged ensemble gains (+0.0348 [+0.0261, +0.0433] and +0.0210 [−0.0160, +0.0579]) share the caveat. A 2025 PLM narrows our margin over the best baseline from +0.0478 to +0.0099 (uniform) and from +0.0684 to +0.0053 (length-matched), without closing it: PIT-GCL leads all nine paired PPIRef comparisons and the pooled interval excludes zero throughout. Under length matching we take the conservative reading: 0.005 against a single-fold SE near 0.006 is consistent in sign, significant when pooled, not decisive. On PPB we claim no statistical superiority.
W6) single seed row bootstrap. Replaced by a cluster bootstrap resampling complexes. Applying that standard uniformly, we withdraw the A8a claim (per-seed −0.0054, −0.0048, −0.0013; three-seed interval crosses zero) and report the structural attention bias as unattributed on the same grounds (+0.0014, −0.0010, −0.0006; p = 0.27). Details under 2CYy W2-3.
Q5) persistent homology against parameter-matched geometry descriptors. We do not report this comparison, and we state that as a limitation rather than a result. We have removed the two descriptors from the released source so the archive matches what we report. We agree it is a reasonable control to ask for.
Re:Review
W1&Q4) “all coordinates come from resolved complexes; the 6 Å interface crop is an oracle.” We have measured it. Table in our response to Reviewer J543 separates the two oracles: knowing which residues form the interface is worth −0.0952 AUROC with crystal coordinates and −0.0923 with predicted unbound ones, and −0.2833 to −0.3080 in accuracy. Replacing bound coordinates with coordinates predicted for each chain alone changes nothing measurable (+0.0024 to +0.0038 across all four ). Of the two objections the crop invites, one is confirmed at that size and one is not supported here.
W2-1)“the negatives are not verified non-interactors.” Conceded for PPIRef; we will cite the convention and mark it a limitation rather than defend itWhat does address it is a wet-lab measured set: 1,320 AlphaFold-3 designed candidates against 15 targets, 354 measured binders and 966 verified non-binders, where our model reaches 0.5013 ± 0.0253 (macro-average of per-target AUC). We will report that negative outcome. 1,320 AlphaFold-3 designed candidates against 15 targets, 354 measured binders and 966 verified non-binders, where our model reaches 0.5013 ± 0.0253 (macro-average of per-target AUC). We will add report that negative outcome.
W2-2) “0.8138 and 0.7905 are construction cues.”
Appendix B reports rows one and four. We add two and three: the length cue collapses both when negatives are length-matched and when they are measured non-binders rather than re-paired chains. The last row is why we retain the Appendix B note, 0.7905 arises from the interaction terms that expose the length cue, not the descriptor, and the concatenated form scores exactly chance. The underlying point stands: much of the submitted benchmark’s difficulty was construction, which is why every ablation and baseline comparison here is reported under both constructions.
W2-3&Q3) “the length-matched analysis is incomplete.” All 17 ablation arms under both protocols (2CYy W1-2); DeepDTA, PIPR and PLM-interact under both constructions (J543 Q3). Geometry controls under Q5.
W3&Q2) “no protein / chain / PDB / sequence disjointness.” Answered by the protein-disjoint split under 2CYy W2-1: complex, PDB-ID, chain-instance and exact fragment-sequence overlap all exactly zero across every partition pair for all three seeds, largest component 1.06% of the dataset. Retrained on it the full model scores 0.9285 ± .0027 against 0.9305 ± .0048, topology margin +0.0114 ± .0016, positive on every seed. Re-pairing is strictly within partition. What the submission bounded, we now measure, and we state the limit: this is exact-sequence disjointness, not homology or fold disjointness.
W4 & Q1) swap test. Reported in full under J543 Q4: 7.9–9.0% of pairs change their 0.5 decision, the non-canonical ordering costs 0.0075–0.0095 AUROC with the same sign on every seed, and symmetrised inference removes the dependence at no cost (within 0.0002 of the forward pass on every seed). We adopt symmetrised inference as the recommended protocol.
W5) “the baselines are old; the ESM MLP is untuned.” We added PLM-interact (2025), an end-to-end fine-tuned ESM-2 pair model, and retrained it on each benchmark. PIT-GCL achieves higher mean AUROC across all five evaluation settings, including length-matched negatives and protein-disjoint evaluation.
AUROC. PLM-interact was retrained eighteen times on PPIRef (three blocks × three seeds × two negative draws); margins are per-seed paired differences. Each PPIRef row carries two statistics: a paired t over three seeds (df=2), asking whether a fresh run reproduces the ordering, and a row-level paired bootstrap over 2,000 resamples with models fixed, asking whether the margin holds on these rows. The protein-disjoint row is pooled over all components to stay row-matched to PLM-interact; excluding the 542-chain component gives 0.9285 ± 0.0027 and a margin of +0.0114 ± 0.0016. TCR–pMHC and PPB-Affinity use five seeds each, with verified test-row alignment and matched inputs.