- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Prediction of MOF properties is critical for material science. This study proposes a two-stage framework that continually pretrains the Granite language model on PubChem records and MOF literature, and then fuses its frozen MOFid representations with 18 interpretable CIF-derived descriptors through cross-attention. The extensive experiments demonstrate the effectivenss of this multimodal framework. However, the reviewer is concerned about the novelty, missing baselines, and incomplete ablations.
Critical strengths
-
The authors selected an interesting and important problem of materials, the CO2 adsorption prediction. The proposed model achieves the lowest reported MAE across all three CO₂ adsorption targets among the evaluated baselines, demonstrating useful predictive gains over strong structure-pretrained models.
-
The model is pretty strong under limited supervision. With 500 and 2,000 labeled examples, the domain-adapted multimodal model outperforms PMTransformer on QMOF band-gap prediction and all CO₂ adsorption targets, suggesting its value when labeled data are scarce. However, with full supervision, some baselines like PMTransformer are the best, such as for CH4.
-
I found that the authors claim no use of AI assistant tools for writing, etc. This is very rare in today's research community.
Critical weaknesses
-
The novelty is kind of overlapped with some prior studies like L²M³OF and is incremental from my perspective. Continual pretraining, handcrafted features, and cross-attention are all mature techniques. The main contribution is the combination of those existing parts and ablations without any new learning algorithms or architectures.
-
The experiments are still inadequate for this empirical-oriented paper. For example, the fusion ablation does not fully isolate the effect of cross-attention. A stronger control would use learned token pooling followed by concatenation, with comparable model capacity and training settings. Besides, the generalization and pretraining analysis remain incomplete. The paper does not evaluate generalization to unseen linkers or topologies. Moreover, the overlap analysis covers only exact SMILES matches with PubChem, leaving potential exposure through the MOF literature corpus unexamined. Finally, Section 4.3 compares an unadapted LLM-only model with a domain-adapted multimodal model, confounding structural fusion with continued pretraining. A comparison using the same domain-adapted backbone is needed to isolate the contribution of each modality.
-
I am also curious about the comparison with frontier LLMs, which is very helpful for contextualizing the benefits of domain adaptation. Where feasible, please evaluate a representative frontier LLM using MOFid and the same structural descriptors under clearly specified zero-shot or few-shot prompting. Such results should be reported separately from supervised baselines, given the differences in training data access and evaluation protocols.
P.S. Besides, there are several paper writing issues that may need further improvements. For instance, Figure 1 is relatively small, and it is difficult for readers to clearly see the letters inside each box. The authors can crop the empty space and resize the image. For tables (Table1 & 2), it is better to bold the best results and underline the second so that we can immediately compare the performance of the proposed methods with others. There are so many numbers, and it is costly for me to calculate the gap between MOFid and other baselines.
Questions for authors
The paper omits the closely related L²M³OF (arXiv:2510.20976), which integrates crystal representations with an LLM for MOF property prediction and other tasks. Please clarify the methodological differences and, where feasible, provide a comparison under matched evaluation settings.
L^2M^3OF: A Large Language Multimodal Model for Metal-Organic Frameworks 2025.
Dear reviewers,
As the authors have posted their responses, I would encourage you to actively parcitipate in the dicussion.
Thank you.
Best,
AC