- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors propose using a canonicalized representation for 3D molecule generation tasks. The method first projects each sample to a canonical representation and then trains diffusion (or flow) models on these canonical representations. This enables the use of non-equivariant models, which the authors claim leads to faster and more accurate training. This is backed by universality and error reduction theorems proved in the paper. The proposed methods is evaluated on QM9 and GEOM-DRUG benchmarks.
Critical strengths
The overall presentation of the paper is relatively clear, and Figure 2 makes the pipeline concrete. The central claims (i.e., theorems) appear correct, and the assumptions are clearly stated. Importantly, I was able to check technical details in the appendix when needed, including proofs, experimental details, ablation studies, and related work. The authors are upfront about the limited experimental scope of the paper (i.e., evaluation only on unconditional small molecule generation).
Critical weaknesses
(Reproducibility) While the paper includes important implementation details, I was unable to verify the code. Some baseline results seem to be taken from prior work, which appears to be the reason for the lack of standard deviations. The authors should clearly state the source of these numbers.
(Quality) The presented methods in Tables 1 and 2 are inconsistent: Table 1 does not include CanonFlow, whereas Table 2 does not include PCS results. The authors defer the entire related work section to the appendix, which makes the paper hard to place in context. To the authors' credit, they mention prior work on non-equivariant diffusion models, but do not include them in the baselines. While the authors mention in the introduction that equivariant models incur substantial architectural and computational overhead, the actual training time is similar (or longer) for the proposed method as detailed in Appendix E.1.3, which seems contradictory.
(Significance) I think the performance improvement is marginal. The core metrics (atom stability, molecule stability, and validity) are all validity-related, which may be unimportant for practical applications (since baselines already achieve over 95%, and rejection sampling can easily filter out invalid molecules). The experimental scope is currently quite limited. The paper would be significantly strengthened by additional evaluations, such as conditional generation tasks.
Questions for authors
- Do the authors plan to release the code and configuration files for reproducibility?
- Could the authors soften the phrase "similar or even less computation" in the abstract, given the training time observations reported in Appendix E.1.3?
- Could the authors provide the full results for CanonFlow in Table 1? If these results are already present in the appendix, please point to the specific table or section.
- Could the authors provide additional metrics or experiments (e.g., conditional generation or downstream tasks) that clearly demonstrate the practical advantages of the proposed method?
3 comments
I thank the authors for their response. However, I am still concerned about the performance and the scope of the paper. The paper would benefit from more thorough experiments.
Thank you for the follow-up. We would like to clarify how the theory and experiments fit together again. Our theory establishes universality for invariant target distributions, characterizes the expressivity gained by modeling on a canonical slice, and explains why learning can be easier through simpler diffusion scores and reduced flow-matching target variance under group-aligned couplings. In unconditional 3D molecular generation, we show faster empirical convergence in validation quality, and show that CanonFlow achieves higher validity and molecule stability than SemlaFlow on GEOM-DRUG with fewer inference step. We welcome broader evaluation on conditional generation and downstream tasks, but we believe the theoretical and empirical contributions stand on their own. In light of these results, we hope you will consider raising your score.
Author Rebuttal
We appreciate the reviewer's feedback. We answer your questions below.
Weakness 1 & Question 1: Source code
Yes. We intend to release the code and configuration files upon acceptance. For now, we upload our code to this link \url{https://anonymous.4open.science/r/CanonFlow-Rebuttal-ICLR-E48F/}. All the experimental results can be fully reproduced. We indeed take some baseline results from previous papers, however all the settings are fully identical, and our reproduced results are basically the same.
Weakness 2 & Question 2 & Question 3
We will modify our phrase to avoid confusion. However, we respectfully emphasize that our reported timings support the description of similar computation. In the GEOM-DRUG comparison in Appendix E.1.3, SemlaFlow, canonicalized SemlaFlow, and CanonFlow take 60.8, 61.3, and 61.7 hours, respectively—differences of approximately 0.8% and 1.5% from the baseline. The other same-device comparison is 10 h 13 min versus 10 h 15 min, a difference of about 0.3%. These are essentially comparable training costs, consistent with retaining the base computational structure while improving generation quality.
In terms of "less compute", we aim to highlight the actual efficiency in both training and sampling. Figure 3 shows faster improvement in validation quality during training, especially with the aligned prior. Table 10 shows that CanonFlow at 50 NFE exceeds SemlaFlow at 100 NFE in both molecule stability and validity. Please note that we intentionally keep the training FLOPs almost the same as baselines, which is the standard "iso-FLOPs" comparison in modern AI papers: with controlled FLOPs and training time, our method significantly outperforms the baseline; to achieve the same performance, our method takes significantly less time than baseline. Thus, comparable fixed-budget training time and improved learning/sampling efficiency are consistent observations.
We additionally evaluated CanonFlow, as well as a genuinely non-rotation-equivariant Transformer backbone on QM9:
CanonFlow is also slightly better than the equivariant SemlaFlow and much better than non-equivariant baseline without canonicalization. Again, the canonicalized SemlaFlow variant retains the underlying equivariant SemlaFlow architecture and adds canonical-rank conditioning, whereas CanonFlow uses the Canon architecture described in Section 4.2 which is internally non-equivariant. Hence, our method improves both equivariant and non-equivariant models, while retaining an established backbone lets us examine the canonicalization framework within an existing molecular generator.
As stated in the paper, PCS is only an optional sampling and has small effects on the performance in Table 2.
Weakness 3 & Question 4: Benchmarks and metrics
We agree that the the metrics and datasets are kind of saturated. However, these are standard and common settings in similar papers -- unfortunately, we cannot find alternative metrics or benchmarks in unconditional generation. Conditional generation is also beyond the scope of this paper, which involves more complicated design space and deserve a separate publication.
The GEOM-DRUG comparison is less saturated: SemlaFlow has 93.9% validity, versus 95.0% for canonicalized SemlaFlow and 95.9% for CanonFlow. CanonFlow also improves molecule stability from 97.3% to 98.4%. These are improvements of 2.0 and 1.1 percentage points, respectively.
A stronger result is the quality–NFE comparison in Table 10: CanonFlow at 50 NFE achieves 98.0±0.08% molecule stability and 95.4±0.09% validity, compared with 97.3±0.08% and 93.9±0.19% for SemlaFlow at 100 NFE. Against SemlaFlow at the same 50 NFE, the gains are 1.0 and 1.5 percentage points. This shows better reported quality with fewer neural evaluations, while leaving the end-to-end wall-clock advantage to be measured directly. We believe these contributions are already solid enough for a conference paper.