1. Protein transfer is promising, but the source of the improvement is not yet isolated
The matched-size comparison between pretrained variants IV and V is valuable. Nevertheless, adding the MLIP task also changes the task mixture, introduces latent equivariance regularization, and changes fractional-coordinate and lattice loss weights substantially (Appendix C.2). For example, the fractional-coordinate weight changes from 10 to 0.25. The experiment therefore tests a training package, rather than isolating force and energy labels as the cause.
There is also no same-capacity, matched-budget comparison of OMol-only pretraining against OMol+OMat pretraining for protein transfer. Adding OMat in Table 1 simultaneously changes model size. The current results establish that the joint corpus and recipe can provide a useful initialization; they do not establish that inorganic material data contributes to the biological gain.
The data boundary matters here. OMol25 explicitly includes biomolecules and MD configurations of cropped protein pocket–ligand complexes (Appendix B.1). Please report overlap or homology between the parent protein structures in pretraining and SCOPe, and clarify which biological structures are present. A pretraining ablation excluding biomolecular subsets would help distinguish transfer from general small-system physics from transfer supported by already related biological environments. This is not an allegation of leakage: broad biological pretraining can be legitimate, but the source of the information changes the interpretation.
Finally, SCOPe-2k is one fixed, fold-balanced sample of 2,000 domains from 488 fold groups. That is a useful setting, but not enough to characterize data efficiency generally. Independent subset seeds and a small 1k/2k/4k learning curve would be more informative than additional sample galleries. At minimum, please repeat the central transfer comparison across training seeds and report uncertainty by length bin.
2. The protein novelty metric is strongly affected by the length-extrapolation setup
Appendix D.9 defines novelty by the maximum TM-align score against SCOPe-2k, normalized by the generated query length, with a novelty threshold of 0.5. Training structures are at most 128 residues, while extrapolated queries reach 256.
This creates a mathematical length effect. If a query has length Lq and a reference has length Lr, the standard query-normalized TM-score is bounded by Lr/Lq, because there can be at most Lr aligned residue pairs and each contributes at most one. For a 256-residue query compared with a 128-residue reference, the score cannot exceed 0.5 even under perfect alignment of the entire shorter reference. Almost any mismatch then makes it “novel.” A longer protein can therefore contain a familiar training domain and still receive a low query-normalized score.
The increase from roughly 10–17% novelty in-distribution to 89–96% out-of-distribution cannot be interpreted as evidence of new folds without correcting for this effect. Please compare against a length-matched structural database, report both normalization directions and alignment coverage, and include a domain- or fragment-level nearest-neighbor analysis. Novelty relative only to 2,000 short training structures is also narrower than novelty relative to known protein structures.
This concern does not erase the designability gain, which uses a different metric. It does weaken a major part of the diversity/generalization interpretation. Similarly, the number of designable clusters should be compared after subsampling equal numbers of designable structures; otherwise, a method that simply produces more designable samples has more opportunities to form clusters.
3. The protein evaluation establishes backbone compatibility, not the full all-atom generation claim
The model produces an atom14 representation and includes a sequence head, but Table 3 redesigns eight sequences with SolubleMPNN and evaluates Cα agreement after ESMFold2 refolding. This is a sensible backbone-generation benchmark. It does not directly test whether the model's own sequence, side-chain geometry, and backbone are mutually compatible.
Please evaluate the generated sequence without inverse-folding replacement and report side-chain stereochemistry, clashes, bond geometry, and sequence–structure consistency. A second folding evaluator on a representative subset would help assess evaluator dependence. The current best-of-eight protocol and absence of a pLDDT gate are clearly documented; sensitivity to refolding confidence and the 1.5 Å threshold would still be useful. These computational tests need not be replaced by experimental validation for this methodological contribution.
Checkpoint selection also deserves a precise account. Appendix E.3 evaluates 96 backbones per checkpoint and selects a designability/novelty trade-off. Please specify a deterministic selection rule, the length distribution and random seeds used in the sweep, and whether the final evaluation uses independent samples. The plotted trajectories are useful evidence against a single arbitrary checkpoint, but they do not measure variation across training runs.
The appendix clearly accounts for the 100k pretraining step offset: the final models use approximately 20–30k local fine-tuning steps, versus 25k for Zatom-2 from scratch. This makes the local optimization budgets reasonably comparable; the remaining question is the stability of checkpoint selection and training across runs.
4. The material results reveal substantial negative transfer that the main narrative understates
The most consequential counterexample appears in Table 9. Adding MLIP supervision from variant IV to V changes OMat24 structure prediction as follows:
| Metric | IV: generation + structure | V: + MLIP | VI: larger + MLIP |
|---|
| Structure match rate | 44.6% | 29.4% | 46.0% |
| Median mean force norm, eV/Å | 2.765 | 32.458 | 18.867 |
| Target median absolute force-norm error, eV/Å | 1.703 | 30.553 | 17.380 |
These are large physical-quality regressions, not small fluctuations. Because the reported statistics are medians, rare extreme outliers alone cannot explain them. Scaling restores the match rate but leaves force consistency much worse than the generation/structure-only model. Table 10 likewise reports high OMat24 force norms after MLIP-heavy fine-tuning.
Please discuss this result in the main text and determine whether it arises from loss reweighting, the shared representation, periodic geometry reconstruction, or another aspect of the implementation. A material can pass a tolerant, volume-rescaled StructureMatcher test while still having unfavorable local distances; the disagreement between geometric matching and force evaluation is itself informative.
The separate MP20 generation benchmark also shows a trade-off. Table 12 reports 4.92% MetaSUN, but only 70.24% overall validity and 53.44% uniqueness. The corresponding Zatom-1-L values are 95.0% and 90.4%. A higher yield on the selected metastability metric is meaningful, but it is not an across-the-board improvement.
Moreover, the stated MetaSUN criterion excludes Ehull≤0. Please report stable, metastable, and combined stable-or-metastable unique novel yields, with uncertainty from the MLIP ensemble. Otherwise, a metric that excludes stable predictions cannot alone support a broad ranking of physical quality. A stratified DFT check of some generated materials would strengthen the scientific interpretation, particularly near the 0.1 eV/atom threshold.
5. The force metric supports limited controllability, not a complete assessment of physical realism
Mean force norm is a reasonable descriptor of distortion. The validation-set agreement between UMA and the DFT metadata, 0.00587 eV/Å for OMol25 and 0.02462 eV/Å for OMat24, is a useful calibration. However, it evaluates the proxy on reference structures, not on arbitrary generated geometries where extrapolation failures may be more severe.
A high AUROC at a coarse threshold can coexist with poor calibration within each regime, as the authors acknowledge. Matching one scalar also does not establish a realistic force field, the correct conformation, or thermodynamic stability. A small mean can hide a highly strained local region, and a stationary point need not be a stable minimum.
For unconditional generation, composition is generated as well as geometry. A force condition could therefore alter the sampled composition instead of controlling relaxation for a fixed chemical system. The graph-conditioned structure prediction experiments partly address this concern and should be emphasized. Please add repeated force sweeps for the same graphs/compositions, per-atom force-tail statistics, and generated-sample validation with an independent potential or a modest DFT subset.
The coverage of the reported metrics also needs to be explicit. UMA target MAE is computed only for successfully scored samples; report the failure rate and its dependence on force condition. RDKit validity is based on the largest molecular fragment (Appendix D.2), which can conceal poor whole-system outputs. For genuinely multicomponent OMol systems, the solution is not to require a single connected molecule, but to report fragment counts, retained atom fractions, and whole-system chemical/physical checks.
Finally, the conformer-training filter removes disconnected structures after OpenBabel bond inference, excluding 60.32% of OMol25. Some excluded structures are legitimately multicomponent, while some connected inferred graphs may still be wrong. Please characterize the retained subset and avoid equating connectedness with reliably recovered chemistry.
6. Benchmark and scaling results need clearer separation from the pretraining claim
The QM9/MP20 and GEOM-Drugs benchmarks characterize separately trained instances of the architecture. They are useful, but they do not directly demonstrate the benefit of OMol25/OMat24 pretraining. Please label this distinction prominently and compare the new architecture with Zatom-1 under matched data, capacity, training, and sampling budgets where practical.
The scaling experiment also needs a precise budget definition. Appendix C.2 defines an epoch as approximately five million replacement draws, whereas Table 7 lists the 500k-per-domain runs as “16 * 5 = 80 epochs” and reports about five times less compute than the full-data runs: 540 versus 2,850 A100 GPU-hours for the base model and 790 versus 4,090 for the large model. The current presentation does not cleanly separate coverage from optimization budget. Please plot quality against optimizer updates, tokens, and GPU-hours, and include a same-compute smaller-corpus control. It is fair to conclude that more data and compute improve these runs; isolating data coverage requires a stronger comparison.
The reported molecular benchmark gains are also mixed. On GEOM-Drugs, Zatom-2 has lower validity and lower valid-and-PoseBusters-valid yield than TABASCO, although it is competitive. On conformer generation, Table 14 shows improved precision but reduced recall; the appendix appropriately acknowledges this. These results support broad competence, not uniformly superior generation.
Author Rebuttal for Reviewer v8Po
Author Rebuttal
We thank Reviewer v8Po for their constructive review and for noting Zatom-2's unified multi-task design and physics-based pretraining benefits. Below we address W1–W2 and Q1–Q2.
1. Methodological Design and Mechanistic Insights (W1)
Unifying small molecules, periodic materials, and all-atom proteins in one generative model required three design choices beyond combining standard losses. First, discrete atom type or lattice diffusion processes do not extend naturally to variable-length all-atom protein generation. Zatom-2 instead transports molecules (
atom1), materials (atom1), and proteins (atom14) through one shared Cartesian velocity field while recovering atom types, amino acid types, fractional coordinates, and unit cell geometry via endpoint-gated readouts (g1 A˚(t), Equation 5). In short, Zatom-2 introducesatom1to unify chemical and biological generative modeling. Second, naively combining tasks on non-equilibrium DFT data can cause performance interference: pretraining on OMol25 and OMat24 without force conditioning degrades OOD protein designability below training from scratch (63.0% vs. 67.8%, Table 3). Pairing scalar force conditioning (sF) with anti-leakage task masks (mE,mF) and latent equivariance (Leq) resolves this conflict and unlocks positive transfer (74.8%), while our extended materials training experiment (Appendix E.1, Table 9) shows how endpoint loss weighting governs Cartesian-to-lattice alignment for materials under inference-time guidance.Third, representation probing suggests why physical supervision aids generation tasks. On 768 OMol25 validation molecules (Appendix F.4, Figure 17), energy/force supervision lifts cross-structure 10-NN chemical-subset purity by 12.6–14.9 points across the elements H, C, N, and O. On 128 unseen SCOPe domains (Section 4.5, Figure 4), protein finetuning from Zatom-2 (V) raises cross-protein 10-NN amino acid type purity in Zatom-2's latent space from 84.8% to 88.1% and Calinski-Harabasz separation by 64% (374.9 vs. 228.1) over SCOPe-only training.
2. Protein Energetics, Molecular Quality, and Ligand-Binder Design (W2, Q1)
Addressing Q1a, we evaluated all of Zatom-2's unrelaxed all-atom proteins and scored 4,800 protonated structures with UMA-S-1p2 (Appendix E.3, Table 13). Energy/force pretraining in Zatom-2 (V) yields the lowest bond/angle RMSZ among Zatom-2 variants, cuts steric clashes 3.6× ID and 2.8× OOD over training from scratch (83.2% ID and 48.9% OOD clash-free), lowers heavy-atom forces by 33%–38% below Zatom-2 (IV) (2.73/2.62 vs. 4.10/4.24 eV/Å), and matches native SCOPe-2k binding energies (−9.04 ID and −9.00 OOD vs. −9.03 eV/heavy atom native, vs. −8.77 / −8.84 when training from scratch), while lifting native sequence designability 4.9× over Zatom-2 (IV) (Table 14).
On OMol25 molecules (W2; Tables 1, 9, 21), adding energy/force supervision (Zatom-2 (IV) to (VI)) improves RDKit validity (83.6% to 85.1%), force AUROC (0.713 to 0.817), and conformer mean forces (2.14 to 1.21 eV/Å), restoring 1-fragment median connectivity, raising PoseBusters pass rates from 30.3% to 34.8%, and cutting mean max atomic forces from 7.31 to 4.12 eV/Å.
As suggested, in a new, challenging ligand-conditioned protein binder design task (Q1b; Appendices B.6, E.9, F.3, Table 24, Figure 14), we finetuned the Base-sized Zatom-2 architecture on SPINDR (23,955 complexes) to diffuse
atom14binders around fixedatom1ligands across 1,000 test complexes (137 ligands, three seeds): Zatom-2 (V) beats training from scratch in <1.5 Å designability (4.37% to 6.90%, 1.58×), cluster diversity (27.7 to 48.7), novelty (13.7% to 24.7%), PoseBusters clash-free rates (11.1% to 14.6%), and UMA-S-1p2 pocket intermolecular forces (2.23 to 1.33 eV/Å, −40%).3. Stepwise Task Ablations and Multi-Domain Scaling (W2, Q2)
Table 11 of Appendix E.3 now isolates each pretraining task across three seeds. On OMol25 alone (70M, no materials), training from scratch reaches 53.8% OOD designability (66.6% TMgeo novelty), generation alone (i.e., Zatom-2 (I)) lifts novelty to 73.6%, and force conditioning without structure prediction (II) reaches 55.3% designability and 80.9% novelty.
Answering Q2 directly, adding structure prediction (III) boosts OOD protein designability by +11.2 points to 66.5%, per-sequence success by +7.7 points to 37.8%, and OOD clusters from 473.0 to 601.0, while raising OMol25 validity (82.3% to 84.6%) and force AUROC (0.662 to 0.730). With 140M parameters, force conditioning remains essential (63.0% without it vs. 68.0% in IV), and energy/force supervision (V) reaches 74.8 ± 1.1% OOD designability. Scaling to 270M (Table 9) also relieves cross-domain contention, lifting OMat24 match rate from 0.294 to 0.460.