- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SPIN-BO, a source-guided Bayesian optimization framework for discovering high-response protein variants against a new interaction partner under a limited target-assay budget. SPIN-BO transfers information from previously measured source interaction landscapes through two mechanisms: an adaptively calibrated source-response mean and a source-supervised protein-pair representation used by a target-specific GP residual. The resulting surrogate is updated as target assays accumulate and drives batch Thompson-sampling acquisition. The method is evaluated in controlled semi-synthetic experiments and on 54 retrospective discovery tasks from a human bZIP interaction dataset.
Critical strengths
-
The cross-partner discovery setting is practically meaningful. Reusing existing interaction landscapes to reduce assays for a new partner is well motivated, and the formulation explicitly accounts for the fact that source partners may share broad mutational trends while retaining target-specific effects.
-
The two transfer mechanisms are clearly separated and carefully analyzed. The controlled simulations independently vary source–target response association and representation-aligned smoothness, providing useful insight into when response-level and representation-level transfer help.
Critical weaknesses
-
The setting assumes access to complete and perfectly aligned source interaction landscapes over the same mutant library. These historical measurements are treated as freely available and do not count toward the assay budget. While reasonable for retrospective studies, this is a strong practical assumption and may substantially limit applicability when source landscapes are incomplete, measured on different libraries, or themselves expensive to obtain.
-
The empirical comparison with existing transfer Bayesian optimization methods is incomplete. The related-work section discusses RGPE, DeltaBO, and DynMeanBO as closely related transfer-BO approaches, but the experiments primarily compare against target-only BO, internal SPIN-BO ablations, ALDE-style, EVOLVEpro-style, and random search. The absence of matched transfer-BO baselines makes it difficult to assess how much improvement comes from the proposed formulation relative to existing source-transfer strategies.
-
The additional benefit of representation-level transfer appears modest on the real bZIP evaluation. At 200 assays, SPIN-BO (Both) achieves 95.0% optimum success versus 93.9% for Response Transfer alone, while Response Transfer slightly outperforms the full model on Recall@20 (89.2% vs. 88.7%). The authors themselves note that response-level transfer accounts for most of the gain in this dataset. This weakens the empirical evidence that both proposed components are necessary in realistic data.
-
The real-data validation remains narrow. The retrospective experiments use a single human bZIP interaction dataset, with the primary analysis covering ten panels across four mutant backgrounds. Although the number of retrospective tasks is reasonably large, all tasks come from the same biological system and experimental platform. It is therefore unclear whether the gains generalize to other PPI families, assay types, or mutational libraries.
-
The response-level calibration may become difficult to scale to many source partners. With sources, the calibrated mean contains coefficients, and the paper explicitly requires the initial target design matrix to have full column rank with . Thus, increasing the number of available source landscapes also increases the minimum number of target assays needed before optimization can begin, which may conflict with the assay-efficient motivation.
Questions for authors
-
How would SPIN-BO operate when source interaction landscapes are incomplete or defined over partially different mutant libraries? The current formulation appears to rely on candidate-wise aligned source responses for the same mutant library, which may be restrictive in practical protein-engineering campaigns.
-
Could the authors include matched comparisons with existing transfer-BO approaches such as RGPE, DeltaBO, or DynMeanBO? These methods are closely related to the proposed setting, and such comparisons would better isolate the benefit of SPIN-BO’s adaptive source-response calibration and residual GP formulation.
-
How does SPIN-BO scale as the number of source partners increases? Since the initial target set must satisfy and a full-rank source-response design, does increasing the number of source landscapes substantially increase the required initial assay budget? Could regularization or source selection alleviate this dependence?
-
Is the improvement from representation-level transfer statistically significant on the retrospective bZIP tasks? The full model is only slightly better than response-level transfer alone on several metrics and is slightly worse on Recall@20. Paired confidence intervals or bootstrap differences between these variants would help clarify the additional contribution of the learned representation.
-
Can the authors evaluate SPIN-BO on an additional experimental PPI or protein-engineering dataset? The current real-data evaluation is concentrated on the human bZIP interaction system, so broader experimental validation would help establish generality across different proteins, interaction mechanisms, and assay platforms.
4 comments
W3 & Q4: Incremental representation benefit and paired uncertainty
We thank the reviewer for raising this important question. We agree that the modest differences between SPIN-BO (Both) and Response Transfer in the real bZIP benchmark warrant a careful paired uncertainty assessment. We therefore conducted additional paired analyses and examined the contribution of the learned representation more directly.
-
Paired analysis of incremental discovery gains. We compared Both and Response Transfer across all 54 bZIP tasks using ten matched campaign seeds, aggregating differences equally across the ten panels. At 200 assays, Both improves optimum success by 1.12 percentage points (descriptive 95% background-bootstrap interval: [0.28, 1.88] points) and Recall@5 by 1.56 points ([-0.23, 3.00]), while Recall@20 decreases by 0.52 points ([-1.98, 0.60]). Although the background-bootstrap interval for optimum success excludes zero, a sensitivity analysis jointly resampling mutant backgrounds and campaign seeds yields intervals containing zero for all four discovery metrics. We therefore do not claim a robust, statistically significant incremental advantage.
-
Clarifying the distinction between the two variants. Both variants retain the adaptive source-response mean and target-specific GP residual, with identical fitting and acquisition procedures. They differ only in residual GP geometry: Both uses the source-supervised pair encoder, whereas Response Transfer uses raw pretrained ESM2 embeddings (Section 4; Appendix B.3). Their similar performance is therefore plausible when the source-response mean already captures substantial transferable information. This motivates examining whether the learned encoder provides additional predictive value after accounting for the source-response mean.
-
New held-out analysis demonstrates improved residual prediction. We conducted an additional analysis across all 54 bZIP tasks, randomly selecting 100 or 200 target measurements for training, with identical training sets across representations. For each training set, we first fit a common OLS source-response mean and compute the residuals. We then fit separate Matérn-kernel ridge regressions to these residuals using either raw ESM2 embeddings or the source-supervised encoder, selecting hyperparameters by five-fold cross-validation on the training data. Each residual prediction is added to the same source-response mean. We evaluate the resulting predictions on the five highest-response mutants in the held-out pool, using their true responses only for evaluation, without tuning specifically for high-response prediction. As shown below, the pair encoder reduces held-out top-5 MSE by 6.14% at 100 assays and 5.35% at 200 assays relative to raw ESM.
Additional rebuttal analysis: Held-out top-5 prediction MSE across 54 bZIP tasks (lower is better).
Target assays Source mean only Raw ESM Pair encoder Reduction vs. raw ESM 100 2.916 2.722 2.555 6.14% 200 2.627 2.316 2.192 5.35%
With the source-response mean held fixed, these results provide evidence that the learned encoder improves residual correction in high-response regions. While this does not establish statistically significant incremental gains in the full BO campaigns, it supports the value of source-supervised representations beyond the transferred source-response mean.
W4 & Q5: Additional experimental PPI systems
We thank the reviewer for suggesting broader experimental validation. In response, we have extended our evaluation to two additional experimental PPI systems with distinct protein families, assay readouts, and mutant-library sizes. In each dataset, one partner serves as the target and the remaining five as sources (Section 5; Appendix E, Figures 9–10 and Tables 14–15).
-
IgG1 Fc–Fc$\gamma$R binding. Using the dataset of Keith et al. [1], we evaluated 4,282 shared single-substitution mutants across six receptor conditions, with experimentally measured effective binding affinities (log ). At 560 target assays, SPIN-BO (Both) achieves 83.3% optimum success, compared with 66.7% for DeltaBO and 20.0% for Target-only BO. It also achieves 86.7% Recall@5 and 90.2% Recall@20, outperforming all three transfer-BO baselines on both recall metrics (Appendix E.3, Figure 9 and Table 14).
-
KRAS–effectors/DARPins. Using the dataset of Weng et al. [2], we evaluated 2,417 shared single-substitution mutants across six binding partners, with experimentally measured BindingPCA fitness scores. At 410 target assays, SPIN-BO (Both) achieves 82.0% Recall@5 and 73.3% Recall@20, outperforming Target-only BO and all three transfer-BO baselines on both metrics (Appendix E.4, Figure 10 and Table 15).
Selected final-budget results from revised Tables 14–15; higher is better.
Method IgG1: Opt IgG1: R@5 IgG1: R@20 KRAS: Opt KRAS: R@5 KRAS: R@20 SPIN-BO (Both) 0.833 0.867 0.902 0.800 0.820 0.733 DeltaBO-MS-TS 0.667 0.627 0.690 0.800 0.780 0.658 DynMeanBO-MS-TS 0.300 0.407 0.465 0.700 0.767 0.640 RGPE-2022-MS-TS 0.533 0.453 0.560 0.800 0.773 0.693 Target-only BO 0.200 0.207 0.250 0.800 0.627 0.428 Opt: optimum success; R@5/R@20: Recall@5/Recall@20.
Overall, these results provide additional evidence that SPIN-BO can improve discovery across different PPI systems and assay readouts, with performance gains varying across datasets and metrics.
References
[1] Keith, A. D., Xu, T., Chernova, T. A., et al. (2025). Mapping Affinity and Allostery in Human IgG Antibody Fc Region–Fcγ Receptor Interactions. bioRxiv. https://doi.org/10.1101/2025.03.28.645945
[2] Weng, C., Faure, A. J., Escobedo, A., & Lehner, B. (2024). The Energetic and Allosteric Landscape for KRAS Inhibition. Nature, 626, 643–652. https://doi.org/10.1038/s41586-023-06954-0
W5 & Q3: Many-source scaling, identifiability, and regularization
We thank the reviewer for highlighting this scalability concern. We acknowledge the increasing initial assay requirement of unregularized calibration and discuss two complementary strategies: biologically informed source selection and ridge regularization.
-
Limitations of unregularized calibration. With sources, the calibrated mean contains coefficients. The GLS/REML formulation requires and a full-column-rank initial design, so the minimum initial assay budget grows linearly with . Correlated source profiles may further destabilize estimation. Our primary bZIP experiments use – with , satisfying these requirements, but larger source banks can make this constraint restrictive (Section 3.5; Appendix A.1).
-
Biologically informed source selection. Selecting a smaller, informative source subset reduces the calibration dimension without requiring additional target assays. Our bZIP panels are constructed using subfamily relationships, sequence similarity, and known interaction biology (Appendix C.2, Table 6). Biologically grouped panels exhibit stronger source–target response correlations than biology-agnostic panels (mean Pearson: 0.791 versus 0.076–0.077; Table 10) and larger discovery gains. At 100 assays, their optimum-success improvement over Target-only BO is 28.5 percentage points, compared with 4.0–10.0 points for biology-agnostic panels (Appendix C.5, Table 11 and Figure 8). These descriptive findings support the practical motivation for biologically informed source selection.
-
Ridge regularization removes the full-rank constraint. We added a theoretical extension in Appendix A.5 that penalizes source coefficients while leaving the intercept unpenalized:
For and any nonzero ,
provided is positive definite. Hence, remains positive definite even when or source columns are linearly dependent, removing the original full-rank and requirements. Appendix A.5 also derives the corresponding Gaussian posterior and restricted marginal likelihood, preserving uncertainty in the regularized source coefficients.
Together, these strategies address the initial-assay dependence in complementary ways: source selection limits the number of coefficients to be calibrated, while ridge regularization removes the algebraic identifiability constraint for larger source banks.
W1 & Q1: Incomplete, unaligned, and potentially costly source measurements
We thank the reviewer for highlighting these practical concerns. We have extended SPIN-BO to accommodate incomplete source landscapes and clarified the scope of our assay-budget setting.
SPIN-BO accommodates incomplete source landscapes with different observed mutant subsets. We allow each source partner to have its own set of observed mutants. Missing source responses are predicted using source-specific models trained on available source measurements and ESM2 embeddings, while observed responses are preserved. The pair encoder is trained only on genuinely observed interactions (Section 3.1; Appendix D.1). We further evaluated SPIN-BO across all 54 bZIP tasks under 30–70% source missingness with MCAR and MNAR mechanisms. The results show that GP-based completion preserves substantial discovery gains over Target-only BO and generally outperforms source-mean completion and three source-aware transfer-BO baselines, although performance declines with increasing missingness (Appendix D.2–D.3, Tables 12–13).
Our assay budget focuses on new target measurements. Our setting assumes that historical source interaction data are already available, and the objective is to minimize the additional assays required for a new target. Accordingly, historical source measurements are treated as previously collected rather than cost-free, and only newly acquired target assays count toward the optimization budget.
W2 & Q2: Matched transfer-BO baselines
We thank the reviewer for highlighting the importance of comparisons with existing source-aware transfer-BO methods. Following your suggestion, we have expanded our experimental comparisons under matched source information and target-assay budgets.
Added three source-aware transfer-BO baselines. We have incorporated DeltaBO [1], DynMeanBO [2], and RGPE [3] into our experiments. As these methods were originally developed for general Bayesian optimization, we adapted their core transfer mechanisms to our finite mutant-library setting using pretrained ESM2 embeddings and historical source-response profiles. Details are provided in Appendix B.3, with updated comparisons in Sections 4–5.
SPIN-BO outperforms all three transfer-BO baselines in the primary bZIP benchmark. Across 54 retrospective tasks, SPIN-BO (Both) achieves 82.2% and 95.0% optimum success at 100 and 200 assays, respectively, compared with 73.2% and 91.1% for DeltaBO, the strongest transfer-BO baseline in optimum success. SPIN-BO also outperforms all three baselines in normalized best score, Recall@5, and Recall@20 at both budgets (Section 5, Figure 3 and Table 2). The key results are reproduced below.
Revised Table 2 (selected methods): Multi-source bZIP discovery at 100 and 200 assays; higher is better.
NB: normalized best; Opt: optimum success; R@5/R@20: Recall@5/Recall@20.
Additional experiments support these findings across diverse settings. We further evaluated the three baselines in controlled simulations (Table 1), single-source and biology-agnostic bZIP experiments (Appendix C, Tables 7–9), incomplete source landscapes (Appendix D, Tables 12–13), and two additional PPI systems, IgG1 and KRAS (Appendix E, Tables 14–15). SPIN-BO generally achieves stronger discovery performance across these settings, although some metric-specific exceptions remain.
References
[1] Lin, H., Zhao, B., Kolar, M., & Liu, C. (2026). Provable Accelerated Bayesian Optimization with Knowledge Transfer. AISTATS 2026. https://proceedings.mlr.press/v300/lin26c.html
[2] Qu, C., Liu, M., Lan, J., Dong, S., & Liu, Z. (2026). Incorporating Expert Priors into Bayesian Optimization via Dynamic Mean Decay. ICLR 2026. https://openreview.net/forum?id=ylX5PWfK0v
[3] Feurer, M., Letham, B., Hutter, F., & Bakshy, E. (2022). Practical Transfer Learning for Bayesian Optimization. arXiv:1802.02219. https://arxiv.org/abs/1802.02219