- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
UniTact predicts antibody binding residues (paratopes), antigen binding residues (epitopes) and the contacts between them. It takes sequences as input and uses separately predicted structures, without a known complex pose. Double centering removes broad residue preferences from pair scores to help identify specific interactions. The model is evaluated on SAbDab2 and two AsEP splits. The strongest results are for paratopes; contact detection remains weak.
Critical strengths
Jointly predicting binding sites (paratope + epitope) and contacts without a known complex pose is a useful practical goal. A reliable model in this setting could help guide follow-up structural studies.
Critical weaknesses
- The paper does not show whether its main idea improves prediction. Section 5.4 and Appendix C describe removing centering, changing the interface readouts and varying pooling, but give no numerical results. Section 5.3 claims that antibody-side effects dominate the final contact scores without showing the final-model analysis. Table 4 concerns an earlier model and cannot support this claim. I therefore cannot judge whether centering adds value. Deriving interface labels from contacts is a natural definition, and centering is a standard operation; the contribution needs a demonstrated benefit.
- The comparisons and reported metrics do not establish a clear advantage. Key comparators are missing: WALLE for AsEP, Paragraph and ParaSurf for paratopes, and Epi4Ab and EpiScan for epitopes. Since UniTact uses predicted structures, relevant structural baselines should also be tested on those same predicted antibody and antigen structures, where applicable, for a fairer comparison. A co-folding baseline would show how UniTact compares with predicting a complex directly. Results are also missing on established benchmark datasets such as PECAN, Paragraph-expanded and MIPE. Evaluation on these datasets would help assess whether the findings generalize across benchmarks. The abstract highlights contact AUROC of 0.9203, but AUPRC is 0.0208 and recall is 0.0058: only 0.58% of true contacts are recovered at the chosen threshold. Contact AUPRC is also below ProTact-best-antibody (0.0302), a structure-only baseline in the same table, so the model loses the contact AUPRC column to a baseline while the abstract reports the AUROC. The epitope gain over SPPIDER-seq is modest, and paratope AUPRC (0.7278) is below Paraplume (0.7319). No uncertainty estimates are shown despite ten runs. Precision, F1 and MCC are promised but missing, making the recall comparisons difficult to interpret.
Questions for authors
- What are the matched ablation results with and without centering? Please report the final model's contact performance using the full scores, the additive terms alone and the centered interaction alone. How much useful information comes from the antibody partner?
- Were the baselines retrained on the same splits, and were labels and residue masks matched? Please provide WALLE and a co-folding comparison, or explain any concrete evaluation limitations.
- What exact clustering thresholds, coverage rules and split files were used? Does the AsEP group split separate antigens or only epitope groups? Please also clarify whether contact labels use heavy atoms and exclude hydrogens.
- Can you provide uncertainty estimates across runs, the omitted precision, F1 and MCC, and contact prevalence? These are needed to assess the reported gains and interpret contact AUPRC.