- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SIGMA, a fine-grained alignment objective for autoregressive molecular models. It constructs chemically verified same-suffix triplets to align hidden states of equivalent molecular serializations at each suffix position. Experiments on four molecular datasets using SMILES and SELFIES show improvements in generation quality, prediction consistency, and downstream molecular property prediction.
Critical strengths
-
The chemically verified triplet construction provides a principled way to identify corresponding hidden states across molecular serializations.
-
The experiments cover multiple datasets and molecular representations, with useful ablations and analyses of prediction consistency.
Critical weaknesses
-
Insufficient motivation. Canonical SMILES already provides a deterministic molecular representation. The paper does not clearly establish why serialization inconsistency is a critical limitation for molecular generation or why explicit alignment is necessary.
-
Limited novelty and justification. SIGMA is essentially a fine-grained contrastive alignment objective. It remains unclear why aligning every intermediate hidden state should improve generation, especially since chemically equivalent histories do not necessarily imply identical next-token distributions.
-
Insufficient baseline comparisons. The randomized-serialization baseline uses fixed alternative serializations rather than online augmentation, and standard whole-molecule contrastive learning baselines are missing. Although the QM9 ablations support dense alignment, broader comparisons are needed to establish its advantage over simpler approaches.
Questions for authors
-
Given the availability of canonical SMILES, what practical limitation specifically requires fine-grained serialization alignment?
-
Why should chemically equivalent histories have similar hidden states at every suffix position when their distributions over alternative next tokens may differ?
-
Can the authors compare against stronger randomized augmentation and whole-molecule contrastive learning baselines under matched training and computational budgets?
3 comments
Thank you for your detailed rebuttal. Your responses have addressed my concerns, and I have updated my score to 3.
Thank you for taking another look at our response. Your questions about stronger augmentation and whole-molecule contrastive baselines helped us clarify what aligning intermediate states adds.
Thank you for your thoughtful review. We address your questions by testing what the model learns from explicit correspondence between spellings, beyond what it learns from seeing more spellings.
Q1. What does SIGMA add beyond canonicalization and augmentation? Canonicalization chooses one spelling for a completed molecule. Even online augmentation, which gives the model new spellings each epoch, trains it to predict each spelling independently. SIGMA adds an explicit training signal for which intermediate steps correspond. For example,
CCOandC(C)Oboth describe ethanol and can both appendCto reach the same ether. SIGMA supervises the correspondence at that prediction step. On SMILES–QM9, given the correct prefixes at verified matching positions, top-1 agreement rose from 72.34% to 80.14% relative to canonical training, and the fraction where both predictions matched the shared next token rose from 49.00% to 54.04%. The predictions became more often correct together, not just more alike.Q2. Why align intermediate states if their next-token distributions can differ? A chemically verified shared continuation tells us which prediction steps correspond across two spellings. At each supervised step, SIGMA trains the anchor state to identify the corresponding pre-token state in the other spelling. This gives the model a specific target for alignment without requiring the two states to assign identical probabilities to alternative next tokens. Sharing the next token alone is not enough: the chemical check must also verify molecular equivalence along the shared continuation.
Q3. Does the choice of alignment positions improve free generation? With the same auxiliary sequences and forward passes in the ZINC ablation, correct matches lowered validation FCD by 0.051 on SMILES and 0.542 on SELFIES relative to ordinary language-model training. Shuffled matches did not reproduce those gains, supporting the role of correct state pairing beyond exposure to extra spellings.
SELFIES–ZINC test. SIGMA achieved lower test FCD in all three seeds than both whole-molecule contrastive learning and alignment at the final suffix position. Whole-molecule contrastive controls with and without a projection head were tuned on validation. FCD is mean ± SD across three training seeds.
Whole-sequence readout controls. On SELFIES–ZINC validation (training seed 101), we also compared SIGMA with two ways to form a single sequence vector for contrastive learning. Values are mean ± SD over five paired generations.
Matched GPU training time. On SELFIES–ZINC at 550s, SIGMA with anchor reuse achieved 19.51% lower test FCD than long-run online randomization, winning all three seeds. Each pair used the same physical A100 and the same 111,041 training molecules, with a measured training-time gap under 0.033s (excluding CPU preparation). Online randomization drew new spellings of the same molecules. SIGMA reused the triplet anchor's forward pass for next-token prediction; the alignment loss was unchanged, and the positive and negative views still participated.
Values are mean ± SD across three seeds, with five paired generations per seed. The two 550s rows score the same checkpoints against different references. The separate 415s validation comparison also included the original SIGMA recipe (4.545 ± 0.126); anchor reuse beat both alternatives in all three seeds. See JZ6h (Q1) for the shorter 235s test comparison.