- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
AnchorSet generates 3D molecules unconditionally using a fixed EGNN encoder and standard decoder with a latent diffusion Transformer. It fits a weighted PCA frame with learned weights per atom type on QM9 Bemis-Murcko scaffolds and GEOM-Drugs heavy atoms. When the third moment has low sign confidence, it forms 24 proper signed permutation frames, sampling one in training and picking one by a geometric fingerprint at test time. On QM9, the authors also run rotation and perturbation checks alongside reconstruction audits.
Critical strengths
The canonicalizer is simple and easy to follow. Section 3.2 separates anchor selection from the learned weights per atom type, while Section 3.3 gives a clear rule for discrete frame ties. Restricting candidates to proper rotations preserves input chirality, and test sampling needs no source scaffold.
To be fair, the pipeline beats several baselines. In Table 2, QM9 molecule stability hits 91.3% and validity reaches 95.5%, ahead of RADM DiT-B (87.3% and 94.1%) and GeoLDM (89.4% and 93.8%). On GEOM-Drugs, atom stability rises from RADM's 85.0% to 86.4% with validity near 99.1%, and Tables 5 and 6 show low reconstruction error.
Critical weaknesses
- My main worry is that the ablations never isolate the candidate set. Table 3 drops Murcko-Single even though it appears in the frame and reconstruction audits. There is no learnable single frame baseline either. I couldn't tell if sampling from the candidate set beats one deterministic frame on the same scaffold features, since moving from All-Atom and Heavy-Atom to Murcko-Set changes atom support and alignment along with the candidate policy without matched PCA controls.
- I wasn't convinced by the explanation for the main gain, and a key baseline is missing, so I lean toward a weak reject. From Murcko-Set to Learnable-Set, Table 3 stability jumps from 83.39% to 91.30%. Yet Table 9 frame error worsens from to and flips rise from 1.3 to 1.7. Section 4.4 triggered likelihood drift is also worse at 1.189 versus 0.457. In Table 4, perturbing outside the anchor mask gives zero drift by construction since those atoms never enter the covariance or fingerprint. Also, Section 2.2 cites InertialAR, but Table 2 omits it despite its 94.7% QM9 stability and 97.4% validity beating AnchorSet's 91.3% and 95.5%.
- The evaluation setup shifts across tables. Appendix A sets , where Table 8 lists candidate fractions of 11.25% for Murcko-Set and 11.02% for Learnable-Set with 6 to 8 flips, matching Table 7. Then Table 9 reports 7.344% and 7.083% with 1.3 and 1.7 flips, and I couldn't tell what changed.
- The baselines and likelihood checks leave out too much. Section 4 never maps All-Proc and Heavy-Proc to All-Atom and Heavy-Atom in Table 3. In Table 3, All-Atom hits 78.91% stability versus 87.3% for RADM DiT-B in Table 2, likely because RADM trains its encoder while Section 3.4 freezes it. Section 4.4 also leaves its NLL estimator undefined, and the unweighted Section 3.6 loss defines no likelihood.
Questions for authors
- Under the same backbone and budget, how do Murcko-Single and Learnable-Single generate, and why does Learnable-Set generate better despite worse frame error and likelihood drift?
- What are All-Proc and Heavy-Proc, and why does All-Atom drop to 78.91% stability in Table 3 versus 87.3% for RADM DiT-B?
- What changed between Tables 7 and 8 and Tables 1 and 9, and what does the Section 4.4 NLL estimate?
- How does AnchorSet compare to InertialAR under matched evaluation?
4 comments
Response to Reviewer iNgi
Frame-evaluation differences and NLL definition. Tables 1/9 summarize frame consistency; Table 7 tests gating on/off at fixed checkpoints; Table 8 varies the threshold. Candidate rates of about 7% and 11% come from separate records, both at threshold 0.001, rather than a recorded threshold change. Joint evaluation of final AEs uses the same 1,280 molecules, support construction and paired rotations. At 0.001, Murcko-Set and Learnable-Set use candidates on 11.25% and 11.02%, with severe-error counts of 7 / 8 / 6 and 7 / 7 / 6. The fixed-checkpoint scan gives identical severe-error counts at 0.001, 0.01 and Always24, supporting selective gating at 0.001.
Latent diffusion variational-loss estimator. Section 4.4 estimates a stochastic latent diffusion variational-loss score per molecule, using natural logarithms.
D̂ = terminal-prior KL + T × weighted denoising loss at t
+ zero-time loss + implemented Gaussian constants − log p(N)
t is uniform over 1, …, T.
The evaluator canonicalizes and encodes each molecule, adds Gaussian encoder noise of amplitude 0.00316, and computes terminal KL, SNR-weighted denoising and a separate zero-time term. Errors sum over active latent coordinates and features per molecule. This differs from Section 3.6's dimension-normalized, unweighted training MSE. The score is a stochastic latent variational loss, distinct from exact molecular data-space likelihood or a pointwise upper bound for every random draw.
The rotation diagnostic takes the absolute difference of original/rotated scores with matched encoder noise, diffusion time and diffusion noise. The atom-count term cancels. Three rotations of 1,280 molecules give 3,840 paired measurements grouped by molecule; tail statistics pool these pairs. We will clarify this definition and name in Section 4.4. Unconditional generation starts from an atom count and Gaussian latent noise, then applies reverse diffusion and decoding. It uses no source molecule, scaffold or input rotation, and does not repeat input canonicalization at each step.
Baseline definitions and encoder freezing. All-Proc/Heavy-Proc denote Procrustes pose alignment using all/heavy atoms. All-Atom/Heavy-Atom name the corresponding support choices in the generation ablation. The former describe alignment operations; the latter describe AE configurations supplied to the LDM. We will clarify terminology and map the reported configurations.
All-Atom's 78.91% stability is an internal ablation; 87.3% is RADM DiT-B's published result. They differ beyond encoder freezing. Our randomly initialized encoder stays frozen during AE training, while reconstruction gradients pass through its inputs to the canonicalizer. LDM training freezes the entire AE. This retains a reference latent interface around which the canonicalizer and decoder adapt. RADM Algorithm 1 describes updating the encoder, while its public QM9 AE code freezes it. With a standard DiT denoiser and GNN decoder, AnchorSet achieves 91.29% stability and 95.50% validity, versus RADM's 87.3% and 94.1%.
Comparison with InertialAR. InertialAR v2 reports 94.5% QM9 molecule stability and 97.3% validity, versus AnchorSet's 91.29% and 95.50%, leading by 3.21 and 1.80 points. On GEOM-Drugs, AnchorSet achieves 99.1% validity versus 98.0%, and 86.4% atom stability versus 87.0%. AnchorSet demonstrates generation with structural anchoring and standard DiT-B latent diffusion.
InertialAR defines an inertial frame and atom order to form a canonical token sequence. Its hierarchical autoregressive Transformer sequentially predicts atom types and coordinates, with geometric positional encoding and a diffusion loss for coordinates. AnchorSet handles pose at the representation stage, combining structural support, learned atom-type weights and compact candidate sets with a standard latent diffusion Transformer. InertialAR generates tokens along an atom sequence; AnchorSet denoises latent atom representations in parallel within each reverse-diffusion step. This supports parallel computation; inference time and throughput were not measured in this comparison.
AnchorSet explicitly handles residual frame ambiguity within a structurally anchored representation. Structural support separates pose estimation from peripheral conformational changes, learned weights adapt geometry to reconstruction, and 24 signed permutations with determinant +1 retain discrete frame alternatives while preserving chirality. Latent diffusion then jointly generates molecules without InertialAR's canonical atom sequence or atom-by-atom autoregressive factorization.
Thank you for the additional experiments and clarifications. The new Single/Set results address my concern about missing controls. However, I still have some concerns about whether the full design is needed and how broadly it helps.
First, all generation results use the same AE–latent-diffusion setup, with anchor weights learned through reconstruction. If I understand correctly, your construction could be applied to other setup e.g. ambient space diffusion, flow matching. Could you comment on this and, if possible, include the results in the final revised manuscript?
Second, on the experiment itself, my impression is that the frame diagnostics still do not clearly explain the large generation gains. Separately, the different training budgets also make the Always24 comparison inconclusive.
Third, I am still unconvinced by the 8.39-point gap between the internal All-Atom ablation and the published RADM. I understand the two use different alignment methods, so a matched RADM comparison would help establish the improvement over the closest existing approach.
Finally, what confuses me is that GEOM-Drugs uses all heavy atoms as opposed to Murcko scaffolds to determine the frame. These GEOM results do not directly test the proposed benefit of restricting pose estimation to the scaffold. As a result, I am unsure how useful scaffold-based anchoring is for larger molecules. I think this is the most important question about scalability.
Response to Reviewer iNgi
Thank you for recognizing the Single/Set controls.
Extensions to other generators. AnchorSet handles pose and discrete frame ambiguity at the representation stage, independently of the latent diffusion objective. The revision will add latent flow matching to compare AnchorSet with baseline representations, reusing each representation's frozen AE with matched latent dimensions and generator capacity. This tests transfer across objectives while retaining reconstruction-learned representations. Coordinate-space diffusion requires new generator training and remains future work. The revision will describe its interface: fixed scaffold support and uniform weights define canonical clean-coordinate targets; generation starts from noise.
Frame consistency and training budgets. Main Learnable-Set results are 91.29±0.23% molecular stability and 95.50±0.16% validity (SD across three independent AE–LDM training runs, ddof=0). In the original AE comparison, Murcko-Set matches Always24's severe-frame-error counts using candidates on only 11.25% of inputs, demonstrating selective frame-ambiguity handling.
We additionally completed an equal-budget comparison: Murcko-Set and Always24 both use epoch-4000 EMAs with 1,564,000 LDM updates, each sampled three times with 2,000 molecules per run. Both have 81.37% mean stability; mean validity is 91.12% and 91.42%, respectively. This fixed-stage experiment shows no generative advantage for the adaptive configuration; the earlier score difference does not establish a gating-only benefit. The revision will hold training budgets, candidate construction and within-set selection fixed, compare ambiguity-triggered versus always-enabled candidates, and include independent training repeats.
On the same 1,280 validation molecules under three paired rotations, Set has lower p99 AE output drift than Single under both weighting choices; 95% intervals for mean differences include zero. In one-step decoded x0 results at t=100/500/900, Always24 has lower mean drift than Murcko-Set throughout. We therefore distinguish frame consistency from generation quality: the former measures how rotation sensitivity propagates to network outputs; the latter directly reports stability, validity, V×U and V×U×N. The revision will report both to test when geometric improvements accompany generative gains.
Official RADM reevaluation and matched comparison. Internal All-Atom stability is 78.91%, versus the published RADM DiT-B's 87.3%, a gap of 8.39 percentage points. Both use a learned rotation network and Procrustes projection; this internal-ablation versus published-result gap does not measure the canonicalization module's contribution. We evaluated the official QM9 DiT-B EMA and its embedded AE with a common evaluator, using three sampling seeds and 2,000 molecules each: stability is 86.82±0.63% and validity 94.20±0.22% (SD across fixed-model sampling repeats, ddof=1). This recovers stability close to the published value, but training conditions remain unmatched (official training update counts are unreported). The revision will match data splits, AE/DiT settings, budgets and checkpoint selection to directly assess the canonicalization module's contribution.
Scaffold use on larger molecules. GEOM's 86.4% atom stability and 99.1% validity use learned heavy-atom support and do not directly test the generative benefit of scaffold restriction. We added geometric diagnostics, applying the same trained Learnable-Murcko AE weights to heavy/Murcko support on 1,280 validation parents. Murcko-to-heavy fallback is 3/1,280; neither support has a >90° frame error under three random rotations.
For 1,034 parents with eligible peripheral heavy atoms, Gaussian perturbations at sigma=0.1 in input coordinate units yield mean frame drift of 6.356° for heavy support and zero for Murcko. Zero drift follows from excluding peripheral atoms from covariance and fingerprint, isolating peripheral changes from the fixed core. Under core perturbations, Murcko drift is 24.963° versus 12.555° for heavy support. Across natural conformer pairs, Murcko has lower mean frame drift but a slightly higher median than heavy support.
Of 55 parents with at least 35 heavy atoms, 51 qualify for peripheral perturbations: at the same scale, mean drift is 12.298° for heavy support and zero for Murcko. Under core perturbations across all 55, mean drift is 6.595° for heavy support and 13.838° for Murcko. Thus scaffold anchoring's value on larger molecules depends on core stability: it isolates peripheral changes, while broader heavy-atom support may be more stable when the core changes substantially. The revision will add a GEOM heavy/Murcko generation comparison matching data, capacity and budgets, reporting scaffold coverage, fallback, and geometry and generation quality by size and flexibility to test whether peripheral isolation benefits larger-molecule generation.
Response to Reviewer iNgi
Thank you for the questions. AnchorSet combines structural anchoring, candidate frames and learned weights for reconstruction.
Single controls and candidate sets. All five AEs completed training. Their final checkpoints were evaluated on the same 1,280 validation molecules, with identical structural support and weight type within each Single/Set pair.
Set reduces severe frame errors in every evaluation seed under both weighting choices. Murcko-Set matches Always24's error counts with candidates on only 11.25% of inputs.
Reconstruction uses latent means without encoder noise on the original inputs. Coordinate RMSE recenters the reconstruction, takes the square root of squared error divided by three times the active-atom count per molecule, then averages molecules, without extra rigid alignment. Distance MAE averages non-diagonal active-atom pairs within each molecule, then averages molecules. All five AEs achieve 100% active-atom type accuracy.
Generation metrics, including both Single configurations, are atom stability, molecule stability, validity, V×U and V×U×N, all in percent.
Set improves all five metrics under both weighting choices. Murcko-Set gains 3.81, 1.58, 0.77 and 15.74 percentage points over Murcko-Single in molecule stability, validity, V×U and V×U×N. Learnable-Set gains 10.57, 3.90, 2.30 and 18.73 points over Learnable-Single. Learnable exceeds Murcko in stability by 1.14 points for Single and 7.90 for Set, supporting learned weighting with candidate frames.
The interim Always24 result achieves 79.50% molecule stability and 53.50% V×U×N, versus Murcko-Set's 83.39% and 64.52%, despite identical severe-frame-error counts. Always24 randomly selects one of 24 frames for every training molecule; adaptive gating uses candidates for about 11% and a single frame for the rest. We interpret selective gating as handling ambiguous poses while reducing extra coordinate variation for high-confidence inputs, concentrating the non-equivariant DiT's training representation. This is consistent with the results; generation checkpoints and training budgets differ.
Frame consistency and generation quality. Frame error and flip count measure consistency across rotated inputs; RMSE measures reconstruction of the original input. Near-equal PCA eigenvalues can make discrete frame selection sensitive to small perturbations, without necessarily increasing reconstruction error on the original input. Learned weights optimize anchor covariance through reconstruction, so higher frame error can coexist with lower RMSE.
Table 9 reports higher operational-frame error for Learnable-Set than Murcko-Set (0.235° versus 0.192°), more flips (1.7 versus 1.3), and higher triggered-subset mean drift (1.189 versus 0.457). Section 4.4 reports median paired drifts of 6.1 × 10⁻⁵ and 4.6 × 10⁻⁵, with both p95 values below 7.1 × 10⁻⁴. Paired scores are stable under these rotations for most inputs; rare extremes dominate the triggered means. Each gate can select different molecules, so these means describe model-specific subsets.
Learnable-Set improves coordinate RMSE over Murcko-Set (0.001898 versus 0.001953) alongside generation metrics. Anchors stabilize global pose, candidates handle ambiguity, and weights adapt to reconstruction, improving the complete AE–LDM.
Zero drift under peripheral perturbations follows by construction when support masks stay fixed and displaced atoms enter neither covariance nor fingerprint. Peripheral conformations can thus change without redefining global pose; candidates handle residual core ambiguity. The perturbation test shows support isolation; Single/Set tests frame ambiguity.