- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors propose ChemDU a task that translates 4D molecular trajectories into grounded text, Chem4DBench a benchmark for 4D molecular understanding and Chem4DLLM model. Chem4DLLM model encodes each frame using 3D-equivariant MLIP model UMA, which are projected together with the Cartesian Coordinates x,y,z, atomic number and PBC into LLM (Qwen 3-8B ) one token per atom per frame. The authors compared the proposed method againt 4D model variant of 3D-MolT5 they designed and 3D-MolT5 and show that Chem4DLLM has better results in most of the cases.
Critical strengths
None
Critical weaknesses
-
The comparison is not controlled. 3D-MolT5 and 4dMolT5 use a different LLM backbone (T5), smaller than the one that Chem4DLLM uses (Qwen3-8B). Chem4DLLM uses UMA for the structure encoder and one token per frame, compared to E3FP fingerprints and flattened fingerprint sequence used by 3D-MolT5.
-
The time dimension is handled implicitly by LLM, and inputs aren't rotation safe. The authors use UMA to encode each frame separately, so they became independent sets of 3D features. The 4D part of time and change is not computed by any structural component so the LLM has to learn by itself to match atoms across frames. Although UMA is equivariant by design, the authors add raw x,y,z coordinates to each atom feature, which will change if the molecule rotates even if chemistry is identical. They keep l=1 features (vectors) which will change direction with rotation. Both of them are fed to LLM without rotation information, so the same molecule in two different orientations will be seen as two different inputs.
Questions for authors
- The Authors use UMA to generate the 6000 extra catalysis data and use the same UMA model to encode the input features. This will overstate how well the model will do when using DFT or experimental data. Why did authors choose the same model for two different tasks?
- For all the datasets what is the UMA barrier = E(Transition State) - E(reactant)? How much is the difference (error) between UMA barrier and DFT barrier for all datasets? What is the difference between UMA's error and LLM's error for all the datasets?
- How will the performance of 3D-MolT5 change if the same LLM backbone is used under a controlled comparison?
Suggestions
- What UMA model and tasks are used in this work?
- "addrss" line 207 page 4
- Table 1 is not needed
- Figure 2 is difficult to read due to the colors used
- Consistency on the paragraph titles, some have "." some don't
- Evaluation paragraph would fit better in the section 5