- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
MODS combines randomized augmented Chebyshev scalarization with surrogate-ensemble sampling to construct scalar rewards for inference-time steering of a fixed discrete diffusion model. The surrogate ensemble is retrained each round using accumulated observations, while the generative model is kept fixed. The experiments cover six assay-derived oracle benchmarks and four model–steering combinations, each evaluated at four steering strengths. On every task, at least one MODS DAPS configuration achieves the highest final mean hypervolume among the evaluated methods.
Critical strengths
-
The framework is clearly formulated. Sections 4.1–4.2 separate the choice of objective tradeoff and surrogate prediction from the diffusion steering procedure through a scalar reward. The experiments demonstrate this flexibility with two diffusion models and two steering procedures.
-
The DAPS results are strong on the reported benchmarks. Table 1 and Figure 3 show that at least one MODS DAPS configuration achieves the highest final mean hypervolume on each task. Comparisons with the corresponding unsteered priors support the benefit of steering, and Table F.2 shows gains at multiple steering-strength settings, although performance depends on the model and task.
Critical weaknesses
-
The comparison with recent inference-time multi-property guidance methods is incomplete. LaMBO-2 is included and provides a relevant multi-objective diffusion baseline. However, Section 2 also cites more recent approaches, including ProteinGuide and PepTune, that are not evaluated, and the paper does not explain whether they can be adapted to the proposed benchmark setting. Since MODS emphasizes separating multi-objective acquisition from the generative model and steering procedure, a comparison with a compatible method that also keeps the pretrained generator fixed would be particularly informative. Without such a comparison, or an explanation of the relevant incompatibilities, it is difficult to assess the practical benefit of the proposed acquisition construction relative to these alternatives.
-
The experiments do not isolate the contribution of surrogate-member sampling. Section 4.1 states that sampling selects a plausible fitness landscape and that varying promotes exploration under predictive uncertainty. However, Table 1, Figure 3, and Table F.2 evaluate only complete MODS configurations against external baselines and unsteered priors. These comparisons do not establish whether sampling ensemble members improves optimization beyond scalarized reward steering alone. Replacing the sampled member with the ensemble mean or a fixed member, while keeping the random Chebyshev weights and steering settings unchanged, would directly test this component.
Questions for authors
-
Can the authors ablate the ensemble-member sampling described in Section 4.1 by replacing the sampled member with the ensemble mean or a fixed surrogate member, while retaining the random Chebyshev weights? Separately, can they compare augmented Chebyshev scalarization with linear scalarization? Sections 2 and 4.1 motivate the Chebyshev form by its ability to recover tradeoffs on nonconvex Pareto fronts that weighted sums can miss, but no comparison tests whether this advantage matters on the evaluated tasks. The steering-strength sweeps in Figures E.1 and E.2 do not address either question, since they vary steering strength while leaving both acquisition choices unchanged. These ablations could use the same surrogate architecture and training protocol under the same evaluation budget.
-
Would the authors evaluate at least one compatible recent multi-property guidance method on the same oracle benchmarks and under the same evaluation budget, or explain why such a comparison is infeasible? ProteinGuide (Xiong et al., 2026) appears particularly relevant because it also guides fixed pretrained generators. For PepTune (Tang et al., 2025), please clarify whether its multi-objective guidance procedure can be adapted from peptide SMILES to the amino acid sequence setting studied here.
5 comments
Official Comment by Reviewer 1sVL
Thank you for the additional comparisons and ablations. Could you clarify how ProteinGuide and MosPro were adapted, particularly whether their property predictors were updated each round, and what explains ProteinGuide’s unusually low performance? Also, given that the single-surrogate variant often performs similarly to full MODS, how much of the reported improvement can really be attributed to ensemble-member sampling? Based on the provided information that linear scalarization also matches or exceeds Chebyshev in several settings, what empirical advantage do these acquisition choices demonstrate over simpler randomized scalarized steering?
Follow-up response on baseline adaptation and ablations
“Could you clarify how ProteinGuide and MosPro were adapted, particularly whether their property predictors were updated each round, and what explains ProteinGuide’s unusually low performance? […] how much of the reported improvement can really be attributed to ensemble-member sampling? […] what empirical advantage do these acquisition choices demonstrate over simpler randomized scalarized steering?”
Response.
Thank you for these follow-up questions. We appreciate the opportunity to clarify the baseline protocols and what our ablations establish. We have added further comparisons in Section G.11 to address your question about updating the baseline predictors.
In our initial comparisons, we followed the fixed-predictor setups used in the methods’ published in-silico evaluations, including additional labeled data to train their predictors before optimization. We apologize for not considering this adaptation in our initial comparison. We have now evaluated iterative adaptations of both methods on GB1 and ERBIN-PDZ1. We removed the additional predictor-training data and instead trained and updated the predictors using the campaign’s initial data and subsequently collected oracle feedback, aligning their access to labeled data with MODS.
Both iterative baselines improve, but MODS retains a substantial performance advantage on both tasks (Table G.6). We include standard MODS and a faster configuration that uses fewer sampling steps under the same oracle-evaluation budget (Section G.10). On GB1, ProteinGuide improves from 47.6 to 171.0 and MosPro from 224.2 to 459.1, compared with 781.4 for standard MODS and 671.7 for faster MODS. On ERBIN-PDZ1, ProteinGuide improves from 20.6 to 191.4 and MosPro from 197.0 to 206.8, compared with 413.8 and 380.8 for standard and faster MODS, respectively. All values are mean final hypervolumes.
The ablations show that surrogate ensemble sampling provides additional gains on some tasks, while the single-surrogate variant often performs similarly. Figure G.8 shows modest benefits from surrogate ensemble sampling, particularly for D3PM with DAPS on KRAS and Src. We believe the single-surrogate variant remains strong partly because each candidate uses a separately sampled scalarization, and the generative sampling procedure is itself stochastic. Both sources of randomness promote diversity among the proposed solutions. These results also give users the option of a simpler single-surrogate configuration while retaining strong performance.
We interpret “simpler randomized scalarized steering” as using a single surrogate with randomly sampled linear scalarization weights. This alternative can be accommodated within our framework, and we expect it to perform competitively on these benchmarks. Our ablations examine these two simplifications separately; we were unable to complete their combined evaluation within the discussion period.
In light of these results, we will explicitly present both randomized linear and augmented Chebyshev scalarization as options within MODS. Linear scalarization is competitive in our experiments (Figure G.9). We favor augmented Chebyshev as a default because it can also recover tradeoffs on nonconvex Pareto fronts that linear scalarization may miss, with little additional implementation or computational cost. This flexibility is useful when the front’s geometry is unknown in advance, although it need not translate into better performance on every task.
MODS’s contribution lies in the framework for combining randomized scalarization, surrogate-guided generation, and sequential feedback, with flexibility in the choice of surrogate and scalarization. Moreover, taken together, the experiments in the paper and the additional evaluations during the discussion provide strong evidence that MODS achieves state-of-the-art performance on the protein optimization benchmarks studied here. We would sincerely appreciate the reviewer taking this expanded evidence and these clarifications into account when reconsidering their assessment and score.
Response to Reviewer 1sVL
Thank you for your thoughtful review. We appreciate your assessment that “The framework is clearly formulated” and that “The DAPS results are strong on the reported benchmarks.” Below, we present additional comparisons with recent multi-property guidance methods and ablations examining scalarization and surrogate ensemble sampling. To keep this response concise and make the additional evidence easy to find, we have collected the supporting figures and tables in Appendix G of the updated manuscript. We will incorporate your feedback, these results, and the clarifications below into the revised manuscript. If these additions address your concerns, we would sincerely appreciate your consideration of a higher score.
1. Comparisons with recent multi property guidance methods
Response.
Thank you for suggesting these comparisons. We added comparisons with ProteinGuide and MosPro on the five two-objective benchmarks (Table G.3, Appendix G). On each task, at least one MODS configuration achieves higher mean hypervolume than ProteinGuide and MosPro. ProteinGuide uses the same oracle-evaluation budget as MODS. For MosPro, we report both a matched-budget evaluation with eight rounds of 100 new sequences and an increased-budget evaluation with fifteen rounds of 10,000 new sequences. These comparisons extend our evaluation beyond LaMBO-2 and include ProteinGuide, which guides a fixed pretrained generator.
PepTune requires a different adaptation. Its released pipeline operates on peptide SMILES, with a tokenizer, masking schedule, and validity constraints tailored to that representation. Our benchmarks instead concern amino acid sequences of full-length proteins. Converting these sequences to SMILES would not by itself resolve the mismatch with PepTune’s pretrained generator. Its property predictors also target therapeutic peptide properties rather than the objectives in our benchmarks and would need to be replaced with task-specific surrogates. Adapting PepTune therefore requires changes to the sequence representation, generator, and property predictors. We could not complete this adaptation within the discussion period. We will clarify these differences in the revised manuscript and include the new ProteinGuide and MosPro comparisons.
2. Surrogate ensemble sampling and scalarization ablations
Response.
Thank you for these suggestions. We added separate ablations of surrogate ensemble sampling and scalarization for D3PM and MDLM with DAPS across all six tasks (Figures G.8–G.9, Appendix G). Results report mean hypervolume and one standard error over five repetitions, under the same oracle evaluation budget and steering settings as the corresponding MODS configurations.
For surrogate ensemble sampling, Figure G.8 compares MODS with a single surrogate, using the same architecture and training procedure as the ensemble members. Performance is generally similar, with clearer improvements from surrogate ensemble sampling for D3PM with DAPS on KRAS and Src. We believe the single-surrogate variant remains strong partly because each candidate uses a separately sampled scalarization, which already promotes diversity. Steering with the ensemble mean would require evaluating all members at every reward evaluation, increasing the computational cost of guidance. We were unable to complete this comparison with the computational resources available during the discussion period, but we will include it in the revised manuscript. The single-surrogate results help clarify the contribution of surrogate ensemble sampling alongside randomized scalarization.
MODS is compatible with other scalarizations, including linear scalarization; augmented Chebyshev is a design choice rather than a requirement of the framework. Figure G.9 compares randomized augmented Chebyshev scalarization with randomized linear scalarization. Relative performance varies across tasks and generative models, and linear scalarization is competitive. We focused on augmented Chebyshev because it can recover tradeoffs on nonconvex Pareto fronts that linear scalarization can miss. Since the geometry of the Pareto front is generally unknown in advance, we continue to recommend augmented Chebyshev as a default. We will clarify this rationale and MODS’s compatibility with alternative scalarizations in the revised manuscript.