- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes an inference-time projection method for improving the physical validity of AF3-style biomolecular diffusion models. Two operators modify the denoised coordinate estimate during the final sampling steps. One corrects severe inter-chain steric clashes, while the other addresses ligand bond lengths, angles, internal clashes, planarity, and tetrahedral chirality. The method requires no retraining or additional denoiser evaluations.
The authors evaluate the approach on Boltz-2 and OpenFold-3 across five benchmarks, reporting 100% target-level best-of-five physical validity with nearly unchanged structural accuracy and minimal computational overhead. Ablation studies examine the timing of projection and compare in-loop correction with post-hoc alternatives. Additional analyses investigate covalent geometry and molecular packing.
Critical strengths
The main strength is the practical simplicity of the method. Bounded coordinate corrections can be inserted into existing AF3-style diffusion samplers without changing model weights or requiring additional denoiser evaluations. The approach addresses common geometric failures at inference time and appears applicable to independently developed models. The ablations in Table 2 also provide useful evidence that corrections are more effective during the low-noise tail than during churn or after sampling.
The empirical improvements are substantial under the reported evaluation protocol. On PoseBusters Complex, target-level best-of-five validity increases from 0.500 to 1.000 for Boltz-2 and from 0.585 to 1.000 for OpenFold-3, while the reported structural accuracy remains nearly unchanged (Table 1). The runtime comparisons in Table 4 show little additional cost. I also appreciate the authors’ effort to examine covalent geometry, packing, and nonbonded energies after projection.
Critical weaknesses
My main concern is that the headline accuracy–validity result relies on target-level best-of-five oracle evaluation. Table 3 defines validity as having at least one valid sample among five predictions. The reported 100% validity therefore does not establish that individual generated structures are consistently valid. It is also unclear whether the accuracy metrics in Table 1 use the same samples selected for validity. If different oracle selections are used, the nearly unchanged accuracy values may not establish that a single selected prediction is both accurate and valid. Per-sample validity and the accuracy of confidence-ranked valid candidates would make the practical benefit much clearer.
The comparison with the closest existing projection method is also incomplete. The paper states that inference-only GSP degrades structural accuracy, citing Chen et al. (2025a), but the cited inference-only experiments use different sampling settings. The revised Appendix D of that work also reports Boltz-2 post-processing experiments without full fine-tuning. These are not directly comparable, but they make the general claim about inference-only accuracy loss less clear. The absence of checkpoints for the fine-tuned GSP model is understandable, while a matched inference-only comparison using the same Boltz-2 checkpoint would be more informative. Without it, the advantage over existing projection approaches is harder to establish.
Questions for authors
- How are samples selected for the accuracy and validity columns of Table 1? Could the authors report per-sample validity and the structural accuracy obtained after selecting a valid prediction using model confidence? This would help establish whether the reported accuracy and validity can be achieved simultaneously in a practical selection procedure.
- Section 3.1 examines four CASP16 targets selected for their highest projection activity. Is the reported reduction in the raw denoiser’s penetration also observed across a broader, less selectively chosen set of targets? The current bootstrap intervals reflect 20 trajectories from these four targets.
- Could the authors clarify the relationship to inference-only GSP and, if possible, provide a matched comparison using the same Boltz-2 checkpoint and sampling budget? This would help distinguish the benefit of the proposed bounded corrections from existing inference-time projection methods.
- Does the implementation include any E/Z stereochemistry correction absent from Algorithms 3–6? If not, could the authors clarify the coverage of the validity evaluation? Please also specify the corrected planarity-check procedure and the Boltz-2 chirality parameter configuration in Appendix C.2.
4 comments
Broader projection activity analysis, E/Z and Planarity corrections and Boltz-2 chirality parameter.
Section 3.1 examines four CASP16 targets selected for their highest projection activity. Is the reported reduction in the raw denoiser’s penetration also observed across a broader, less selectively chosen set of targets?
We thank the reviewer for this question and have repeated the analysis on a much broader, non-selected set of targets. We instrumented the sampler on every target in CASP15, CASP16, and the PoseBusters Complex set on which the van der Waals projection can act at all. These are 225 targets, giving 1,125 trajectory pairs, none of which was selected based on projection activity or outcome.
The two findings of Section 3.1 hold across the full set.
First, the model retains a small, stable fraction of each correction. The rebound ratio is 0.908 (95% CI [0.899, 0.918]) across all 225 targets and lies between 0.904 and 0.921 on each dataset. It remains essentially unchanged when the four most projection-active targets, which we reported initially, are excluded (0.906).
Second, the penetration of the model's own, unprojected prediction x0raw decreases over the projection window, while that of the seed-matched control increases. The median decline per trajectory is 66.8% (95% CI [65.8%, 67.9%]), whereas penetration in the seed-matched control increases by a median of 12.5% (95% CI [10.7%, 13.8%]).
We will include the per-dataset breakdown in a new appendix table.
Does the implementation include any E/Z stereochemistry correction absent from Algorithms 3–6? If not, could the authors clarify the coverage of the validity evaluation?
We thank the reviewer for raising this point. E/Z stereochemistry violations are included in our published validity evaluation and are explicitly checked. As reported, we did not observe any such violations across the datasets in any samples, and therefore did not include a dedicated E/Z Algorithm in the manuscript. However, following reviewer VuH7's suggestion to conduct an independent PoseBusters evaluation, we identified incorrect E/Z double-bond isomers in some samples from two PoseBusters Complex targets. This is because Posebusters’ criteria for E/Z test is much stricter: it fails at about 55 degrees of twist, against 90 degrees allowed by the evaluation developed by Boltz. We have now implemented an E/Z correction which resolves these violations through a single rigid rotation of the smaller side of each affected bond to its correct planar geometry. We will add this step in the planarity algorithm description accordingly. The results reported above include this correction, which eliminates the identified E/Z violations without degradation in structural accuracy, inference time, or GPU memory usage. We thank the reviewer for helping us improve the completeness of our method.
Please also specify the corrected planarity-check procedure
We thank the reviewer for requesting this clarification. The modification in Appendix E.1 corrects an inverted condition in the five-membered-ring planarity evaluator (check_ligand_flatness) in https://github.com/jwohlwend/boltz/blob/main/scripts/eval/physcialsim_metrics.py#L120
Incorrect (Boltz): np.all(ring_5_dists <= 0.25, axis=-1)
Corrected (Ours): np.any(ring_5_dists >= 0.25, axis=-1)
The incorrect condition flags geometrically correct, planar rings as violations, whereas the corrected condition flags rings with at least one atom deviating by 0.25 Å or more from the best-fit plane. We quantified the effect across all generated samples using the unmodified published evaluator as the reference.
| Dataset | Method | Correct evaluator (%) | Incorrect evaluator (%) | Difference (pp) |
|---|---|---|---|---|
| CASP15 (66) | Boltz-2 | 61.5 / 63.6 | 61.5 / 63.6 | 0 / 0 |
| Boltz-2x | 99.7 / 100.0 | 99.7 / 100.0 | 0 / 0 | |
| GSP | 100.0 / 100.0 | 100.0 / 100.0 | 0 / 0 | |
| Ours | 100.0 / 100.0 | 100.0 / 100.0 | 0 / 0 | |
| CASP16 (52) | Boltz-2 | 53.5 / 53.8 | 53.5 / 53.8 | 0 / 0 |
| Boltz-2x | 100.0 / 100.0 | 96.2 / 96.2 | +3.8 / +3.8 | |
| GSP | 100.0 / 100.0 | 96.2 / 96.2 | +3.8 / +3.8 | |
| Ours | 100.0 / 100.0 | 96.2 / 96.2 | +3.8 / +3.8 | |
| PoseBusters Complex (161) | Boltz-2 | 28.3 / 28.0 | 27.3 / 27.3 | +1.0 / +0.6 |
| Boltz-2x | 99.3 / 99.4 | 96.8 / 96.9 | +2.5 / +2.5 | |
| GSP | 99.0 / 98.8 | 96.5 / 96.3 | +2.5 / +2.5 | |
| Ours | 99.4 / 99.4 | 96.9 / 96.9 | +2.5 / +2.5 |
Notes: All validity values are per-sample / confidence-selected top-1. Difference is correct - incorrect evaluator, in % points.
the Boltz-2 chirality parameter configuration in Appendix C.2.
The chirality parameter, K, for Boltz-2 is 1. We will add this information to the manuscript.
We thank the reviewer for their astute observations and helpful suggestions. We hope our answers have removed concerns; we look forward to continued discussion.
Thank you for the detailed response and the additional experiments. I appreciate the effort to address the concerns raised in my review.
The per-sample and confidence-selected top-1 results address my main concern about oracle-based evaluation. The matched GSP comparison and independent PoseBusters evaluation also make the empirical contribution considerably more convincing. I am particularly glad to see the mechanism analysis extended to 225 targets, with the main findings remaining consistent.
The explanations regarding E/Z stereochemistry and the planarity evaluator are helpful. For reproducibility, I would encourage the authors to include the new E/Z correction in the revised algorithm and clarify whether the Boltz-2 chirality parameter is κ = 1.
Overall, I find the rebuttal convincing. The additional evidence has substantially strengthened my assessment, and I am inclined to update my recommendation to weak acceptance.
Thank you for your constructive feedback; we appreciate the revised score.
Evaluation metric and GSP comparison
We thank the reviewer for the detailed and helpful review. The reviewer is right that a best-of-five oracle score says little about whether every individual prediction is physically valid. Our submission reported oracle numbers because this is the convention of the evaluation scripts released with Boltz and later used by GSP, and we wanted our evaluation to be directly comparable with theirs. Nevertheless, we acknowledge that consistency with established evaluation protocols does not overcome the inherent limitations of oracle-based metrics.
As suggested by the reviewer, we have replaced oracle-based reporting with per-sample validity and confidence-selected top-1 validity, alongside structural accuracy evaluated on the same confidence-selected predictions. We have also added an evaluation with PoseBusters, as requested by Reviewer VuH7. PoseBusters is an independent and widely used tool that checks ligand geometry, stereochemistry and protein–ligand contacts, so it lets us test whether the gains hold outside the validity checks used in the submission. We hope that this extended evaluation eliminates reviewers' main concern about our results.
We thank the reviewer for this point and have performed evaluation of GSP using their appendix D experiment, which is possible without the unreleased fine tuning checkpoints. To ensure fair comparison, we use the same base model, Boltz-2, five diffusion samples per target, 10 recycling steps, 200 diffusion steps, identical inputs and precomputed MSAs, and the same random seed. We follow the constraint schedule, solver iterations and guidance weight implemented in the GSP code and apply their correction with all constraints enabled. The results given below will be added to the manuscript as well.
CASP15
CASP16
PoseBusters Complex
Notes: Accuracy and validity values are reported as per-sample / top-1. Per-sample averages across five generated structures per target; top-1 evaluates the highest-confidence prediction. Bold indicates the best value between GSP and Ours, including ties. Time is the mean structure-prediction runtime per target for five samples (seconds), excluding process start-up, input processing, and checkpoint loading. Memory is mean peak reserved GPU memory (GiB).
We evaluate both methods on CASP15, CASP16, and PoseBusters Complex, measuring structural accuracy (lDDT and lDDT-PLI), physical validity, inference time, and GPU memory usage. Our method achieves 100% per-sample PoseBusters validity on CASP15 and CASP16, compared with 88.3% and 86.7% for GSP, respectively, while maintaining comparable structural accuracy and lower inference time. Our method integrates physical corrections into the denoising process, allowing the learned prior to incorporate these corrections into the evolving structure rather than enforcing constraints solely on the final coordinates. The improvements observed under the independent PoseBusters evaluation therefore provide evidence that our approach addresses underlying physicochemical inconsistencies and generalizes beyond the specific criteria of the original evaluation protocol.