- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MoDANet, a dual-branch multi-scale graph Transformer for molecular property prediction. It targets two weaknesses in current atom-level models. First, global self-attention treats all atoms alike: a distant atom counts as much as a bonded one. Second, explicit substructure hierarchy is missing. MoDANet pairs a global branch with a motif branch. The global branch learns a convex mixture over nested, coverage-based shortest-path scopes at each layer. The motif branch works on BRICS motifs and needs no closed fragment vocabulary. The two views are fused by global-context-guided motif aggregation. The main contributions are a distance-masked attention mechanism with learnable per-layer scope mixtures, and a BRICS-based motif branch with no fragment vocabulary.
Critical strengths
The method combines a learnable distance-masked attention mechanism with a BRICS fragment branch that needs no vocabulary. At each layer, attention is a convex mixture over topological scopes. These mixtures can be inspected directly. The approach needs no graph augmentation and no 3D conformers.
Critical weaknesses
The state-of-the-art claim is not adequately supported. Gains over the strongest baselines are small, and they do not hold consistently across datasets. Several baselines were also pretrained on larger or richer corpora. Without experiments that control for pretraining-set size, the sample-efficiency claim remains unverified. The method is moreover close to an incremental combination of existing components.
Questions for authors
The SOTA claim is weaker than stated. MoDANet is best on only 4 of 7 benchmarks, with margins of 0.7 to 3.2 points, and falls behind on Tox21 and MUV. Please report whether these differences are statistically significant. For MUV the gap to SimSGT is 1.9 points; is that difference within run-to-run variance? The controlled comparison is still missing. The authors acknowledged that several baselines use a larger or a richer pretraining corpora, and that controlled scaling experiments are needed. The central claim, however, is that SOTA can be reached with only a 250K-molecule ZINC subset. Please provide at least one controlled experiment in which a strong baseline is pretrained on the identical 250K ZINC subset and fine-tuned under the same scaffold splits and budget. Otherwise the reader cannot separate architecture gains from differences in data and objective.
2 comments
Thanks for your responses. My concerns are resolved. But I still think that the main contribution is combination of existing components.
Response to Q2:
We thank the reviewer for this suggestion. We have retrained SimSGT on ZINC 250K under the same setting as MoDANet.
Under this controlled setting, MoDANet performs better on all seven benchmarks, with MUV essentially tied. On Tox21, MoDANet now leads (77.6 vs. 76.4), whereas it trailed the published result obtained with a larger pretraining corpus.
Response to Q1:
We thank the reviewer for these comments. The pretraining-data concern is addressed by the controlled experiment in Q2: with SimSGT retrained under the same setting (ZINC 250K), MoDANet still performs better on all seven benchmarks, with MUV essentially tied.
Regarding incremental combination, we conducted an additive ablation in which every variant is pretrained independently from scratch under the same setting (ZINC 250K):
The full model performs best on all five benchmarks. Adding GCMA on top of +VDAA+motif brings consistent gains (82.8→87.0 on BACE, 56.7→64.8 on SIDER, 74.5→77.6 on Tox21), and VDAA improves both the base model and the motif-only variant. The gains therefore come from how the components work together, not from simply stacking them.