- Rating
- 3
- Confidence
- 2(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces MultiPhaseWorld, a simulation-grounded benchmark evaluating whether LLMs and multimodal LLMs can connect structural perturbations to their consequences and reason about subsequent evolution in multiphase chemical systems, beyond static structure understanding. It contains 11,075 text and multimodal questions across 28 task types and 14 capability dimensions, organized into four levels: multiphase structure perception, perturbation response reasoning, structural evolution reasoning, and structural prediction. Built from 336 solid–solid heterostructures and 400 solid–gas surface–adsorbate systems, it uses controlled atomic, molecular, surface, layer, and environmental perturbations, followed by structural optimization and molecular dynamics, to generate evaluation data.
Critical strengths
This benchmark seems solid and is beneficial to LLM and Agent research community.
Critical weaknesses
None
Questions for authors
Can you explain why this is important and how it defers from previous benchmarks like AtomWorld [1] and EvoMD-LLM [2]?
[1] Taoyuze Lv, Alexander Chen, Fengyu Xie, Chu Wu, Jeffrey Meng, Dongzhan Zhou, Yingheng Wang, Bram Hoex, Zhicheng Zhong, and Tong Xie. AtomWorld: A Benchmark for Evaluating Spatial Reasoning in Large Language Models on Crystalline Materials. arXiv preprint arXiv:2510.04704, 2026. [2] Zhichen Tang, Zhengzheng Dang, Yulin Chen, Jixin Wu, Haiwen Li, and Yanming Wang. EvoMD-LLM: Learning the Language of Species Evolution in Reactive Molecular Dynamics. arXiv preprint arXiv:2605.29394, 2026.
Thank you for the care you have taken in reviewing our work. If you have a chance before the discussion closes in about two days, we would greatly appreciate hearing whether any concerns remain.