- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors propose adding prompt-order robust training and a model that decides how much diffusion is needed for the 2 stage LLM + Diffusion model conditional crystal generation pipeline. They show ablations suggesting the method outperforms relevant baselines, but exact implications if the two methods contributions remain unclear.
Critical strengths
Critical strengths include:
- Broad evaluation across different model backbones
- Consistent improvements over matched backbone baseline
Critical weaknesses
Critical weaknesses include:
- Prompt-robust training is simple data augmentation, with unclear gains (no clean ablation)
- Noise prediction network lacks simple baselines, e.g. geometry-based heuristics, which would make the contribution of author’s method much clearer
- Empirical gains are modest and don’t outweigh the other weaknesses.
- Conditional experiments only use LLaMA-2, which is very old.
- The error bars are poorly explained
Questions for authors
Could we have ablations for the different components?
What are the error bars showing exactly? And I would like some discussion on why they appear to be smaller than the baselines. There may be very good reasons for that, but I would like to see it discussed.
Summary of Revised Manuscript
Summary of Revised Manuscript
We thank the reviewers for their constructive feedback. We have revised the main paper and the appendix, with all changes highlighted in blue. A summary of the major updates is as follows.
Key Updates
1. Clarifications and corrections
2. Additional experiments
We believe these revisions address the reviewers' concerns and improve the paper.