- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces CoopHyperMoE for molecular graph property prediction. The model computes independent sigmoid memberships for node–expert pairs and constructs an expert hypergraph from similarities between router vectors. For nodes satisfying a low-membership condition, it adjusts these memberships through Gaussian-weighted interpolation using PCA-selected reference experts, before applying normalized top-K routing. The interpolation strength decreases with network depth and training progress. The evaluation covers ten molecular datasets with four random seeds and includes matched ablations on six classification datasets. The results show modest, task-dependent improvements, while the ablations leave the contribution of the interpolation mechanism unclear.
Critical strengths
- The paper investigates whether relationships between experts can improve membership estimates before expert selection. Separating initial memberships, relational adjustment, and final routing makes the proposed intervention easy to identify and evaluate. This is a meaningful direction for studying how expert relationships might inform routing in graph MoE models.
Critical weaknesses
- The experiments do not establish the benefit of the central interpolation mechanism. In Table 3, the full model does not achieve the highest mean score on any of the six datasets, and disabling interpolation improves the mean on four. For example, removing interpolation increases ROC-AUC from 77.63 to 78.63 on BACE and from 67.08 to 68.69 on BBBP. These comparisons leave the added value of the paper’s main new component unclear.
- The specific relational construction lacks sufficient justification to support its added complexity. With sigmoid gating already studied in prior work, much of the methodological contribution rests on the expert hypergraph and interpolation rule. However, the paper does not establish why similarities between router vectors and PCA-selected anchors provide useful information for correcting memberships. The current results also offer limited practical motivation for this construction: predictive gains are small and inconsistent, while the reported ClinTox comparison shows approximately 44% higher training time than GMoE. A clearer empirical advantage or a transferable insight into when this construction helps would strengthen the contribution substantially.
Questions for authors
- On one dataset, how often does interpolation change expert selection or weights, and does it improve performance over disabling it? Please examine both the training and the best validation checkpoint.
- Besides gating and interpolation, do local GMoE and CoopHyperMoE differ in routing noise or regularization? Why do Tables 1 and 3 report different results for the full model?