- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes QDGL, a model for molecule–drug–disease triadic association prediction with multimodal entity features. Each modality is mapped onto a complex unit sphere with learnable amplitudes and phases; modality states are mixed with learned reliability weights into both a real vector and a density matrix per entity. A heterogeneous GAT propagates the vectors, while a second path propagates density matrices through relation-specific unitary transforms, Hilbert–Schmidt-overlap attention and low-rank compression. Triads are scored by an MLP on vector features plus a Tucker interaction on Hermitian measurement readouts, trained with BCE, a ranking loss and four consistency losses across two graph views. On ncRNADrug, CTD and PrimeKG it reports the best Hit@1, MRR and AUC against eleven baselines.
Critical strengths
- The experimental program is unusually complete for this area. Beyond the random-split benchmark, the paper reports pair-overlap-stratified, pair-disjoint, and unseen-entity splits, full-candidate ranking, candidate-pool sensitivity, false-negative contamination, and representation controls (complex vector, real vector, vMF, cosine), all with five-fold SDs. Random triad splitting is explicitly flagged as mostly measuring completion within known pairs, and the harder settings are given rather than hidden.
- Gains are consistent across settings and metrics. In the pair-disjoint and unseen-entity evaluations, QDGL leads on nearly every cell, and full-candidate margins are larger than sampled ones (e.g. CTD molecule–drug-disjoint Hit@1 +36.86 pp over SAFKGC). The case studies attach PMIDs to 28 of 40 top-10 candidates, which is more verification than most papers in this space provide.
Critical weaknesses
- The gains are not attributable to the quantum-inspired path. The vector-only variant ("w/o dual path", Table 3) scores 79.46 / 95.56 / 93.65 Hit@1 against the full model's 80.20 / 96.98 / 94.34, and already beats every baseline in Table 2 by 8–18 pp. No baseline receives the same features, two-view training or six-term loss, so Table 2 cannot separate the architecture from the inputs and supervision. A plain HeteroGNN with the same features and BCE is the missing comparison.
- The headline benchmark is nearly saturated by construction. CTD and PrimeKG positives are closures of three pairwise relations, the graph is built from those same relations, and 71% of CTD test triads have all three pairs seen (Table S9). The hard settings tell a different story: PrimeKG PairSeen0 Hit@1 is 1.65 pp below SAFKGC, and ncRNADrug drug–disease-disjoint full-candidate Hit@1 is 13.21%. The ECFP "robustness" (−4.67 pp vs. −30 to −50 pp for controls, Table S8) coincides with Fig. S8 showing ECFP masking has almost no effect, so the model may simply not use that modality.
Questions for authors
-
Please add a baseline with the same pretrained features, a standard HeteroGNN (e.g. the vector path alone) and BCE only, tuned with the same budget as QDGL. How much of the Table 2 gap survives?
-
What tuning budget did each baseline receive? QDGL's settings (lr 1.78e-4, ω2 1.17, dropout 0.04/0.21/0.07) indicate an extensive search; the baseline text says only "guided by original implementations".
-
For CTD and PrimeKG, how often is a test triad fully recoverable from the training graph (all three edges present)? Please report Table 2 restricted to PairSeen ≤ 1, since that is the setting the method is motivated by.
-
Is ECFP used at all on ncRNADrug? Please report performance with ECFP removed entirely and compare with Table S8.
-
Eq. 7 says U_r is parameterised by a single relation phase; App. S5.3 describes diagonal phase times Householder products. Which is implemented, and how many parameters per relation?
-
ConvNTC reaches 3.55% Hit@1 on PrimeKG, below the 1/51 chance level for sampled ranking. Was it run correctly?
9 comments
Q1. A same-feature HeteroGNN baseline trained with BCE only
We thank the reviewer for suggesting this controlled comparison. Following the suggestion, we trained HeteroGNN + BCE, a heterogeneous GNN following the HetGNN architecture [1], on the same pretrained features with the BCE loss only and tuned it on the validation split. Specifically, the search space and budget are listed below.
| lr | wd | hetgnn_dim | hidden | dropout | Budget | Early-stopping patience |
|---|---|---|---|---|---|---|
| [1e-5, 3e-3] | [1e-7, 1e-3] | {64, 128, 256} | {64, 96, 128} | [0, 0.5] | 30 trials per dataset | 12 (ncRNADrug), 20 (CTD, PrimeKG) |
The search budget of 30 trials per dataset matches that used for QDGL. The results are compared with QDGL below (mean ± SD over five folds, %).
| Full test set | PairSeen ≤ 1 | ||||||
|---|---|---|---|---|---|---|---|
| Dataset | Method | Hit@1 | MRR | AUC | Hit@1 | MRR | AUC |
| ncRNADrug | HeteroGNN + BCE | 66.57 ± 2.97 | 77.24 ± 2.45 | 68.93 ± 2.02 | 65.04 ± 3.36 | 76.27 ± 2.74 | 55.93 ± 3.35 |
| QDGL | 80.20 ± 0.45 | 87.07 ± 0.34 | 93.05 ± 0.54 | 80.55 ± 0.67 | 87.81 ± 0.45 | 93.06 ± 0.81 | |
| CTD | HeteroGNN + BCE | 54.90 ± 0.92 | 70.04 ± 0.77 | 93.03 ± 0.42 | 19.64 ± 2.53 | 34.69 ± 3.15 | 57.74 ± 3.59 |
| QDGL | 96.98 ± 0.08 | 98.03 ± 0.04 | 99.08 ± 0.02 | 45.55 ± 1.81 | 57.82 ± 1.21 | 79.42 ± 0.51 | |
| PrimeKG | HeteroGNN + BCE | 54.53 ± 2.71 | 68.15 ± 1.77 | 90.87 ± 0.47 | 24.35 ± 3.45 | 37.22 ± 3.48 | 69.33 ± 2.20 |
| QDGL | 94.34 ± 0.35 | 96.18 ± 0.34 | 98.07 ± 0.20 | 71.26 ± 2.73 | 79.39 ± 2.12 | 91.20 ± 1.64 |
With the same pretrained features and BCE loss only, HeteroGNN + BCE still trails QDGL on all metrics. On the full test sets, HeteroGNN + BCE reaches 66.57%, 54.90%, and 54.53% Hit@1, compared with 80.20%, 96.98%, and 94.34% for QDGL. On PairSeen ≤ 1 test triads, QDGL exceeds HeteroGNN + BCE by 15.51, 25.91, and 46.91 percentage points in Hit@1. HeteroGNN + BCE stays below the strongest baselines in Appendix Table S5 on all three datasets, which reach 71.58%, 90.68%, and 86.99%, so the gap in Table 2 remains in full, with QDGL still ahead of the strongest baselines by 8.62, 6.30, and 7.35 percentage points.
HeteroGNN + BCE is now included in Table 3 in Section 3.3 and Appendix Table S5.
References
[1] C. Zhang, D. Song, C. Huang, A. Swami, and N. V. Chawla. Heterogeneous graph neural network. In KDD, pp. 793–803, 2019.
Q2. Tuning budget of the baselines
We thank the reviewer for the attention to how the baselines were tuned. We agree that the baselines should receive a tuning budget comparable to that of QDGL, and following the reviewer's suggestion, we added a hyperparameter search for each baseline. Each baseline receives 30 random-search trials on each dataset, matching the search budget of QDGL, with its original configuration counted as one trial. The search selects a configuration on the validation split of the first fold using each method's own validation metric, and the selected configuration is then retrained on all five folds and evaluated on the test sets, without using test results during the search. The search for HeteroGNN + BCE is described in Q1. The search spaces of the baselines and QDGL are listed below.
| Method | Learning rate | Weight decay | Other hyperparameters |
|---|---|---|---|
| TransE | [1e-4, 3e-3] | [1e-7, 1e-4] | dim ∈ {128, 256, 384}, gamma ∈ [6, 18], p_norm ∈ {1, 2} |
| RotatE | [1e-4, 3e-3] | [1e-7, 1e-4] | dim ∈ {128, 256, 384}, gamma ∈ [6, 18] |
| QIQE-KGC | [1e-4, 3e-3] | [1e-7, 1e-4] | dim ∈ {100, 200, 300}, gamma ∈ [1, 8], interaction weight ∈ [0.25, 1] |
| QLogicE | [1e-4, 3e-3] | [1e-7, 1e-4] | dim ∈ {100, 200, 300}, gamma ∈ [6, 18], logic / TransE weights ∈ [0.5, 2] |
| SAGMM | [1e-4, 3e-3] | [1e-7, 1e-4] | hidden ∈ {150, 300, 450}, layers ∈ {3, 5}, dropout ∈ [0.2, 0.5] |
| MTGNN | [1e-4, 3e-3] | [1e-7, 1e-4] | hidden ∈ {64, 128, 192}, heads ∈ {4, 8}, common_size ∈ {64, 128}, dropout ∈ [0.2, 0.5] |
| SpikingHAN | [1e-4, 3e-3] | [1e-6, 5e-4] | input / temporal / scorer dropout ∈ [0.1, 0.5] / [0.2, 0.6] / [0.1, 0.3] |
| ConvNTC | [1e-4, 3e-3] | [1e-7, 1e-4] | rank ∈ {32, 64, 96}, channels ∈ {16, 32, 48}, alpha ∈ [0.25, 0.75], dropout ∈ [0.1, 0.5], input_dropout ∈ [0, 0.3] |
| SAFKGC | [1e-4, 2e-3] | [1e-6, 1e-3] | rank ∈ {250, 500, 750}, attention dropout ∈ [0, 0.3], ranking-loss weight ∈ [0.05, 0.2] |
| TriMoGCL | [1e-4, 3e-3] | [1e-7, 1e-4] | hidden ∈ {128, 256}, lam1 / lam2 ∈ [0.05, 0.2], tau ∈ [100, 1000] |
| HySAE | [1e-4, 2e-3] | [1e-7, 1e-4] | dr ∈ [0.97, 1], input_drop ∈ [0.2, 0.8], hidden / feature drop ∈ [0.1, 0.4], lamda ∈ [0.2, 0.8] |
| QDGL | [1.2e-4, 5e-4] | [5e-5, 4e-4] | model / edge / message dropout ∈ [0.03, 0.15] / [0.10, 0.30] / [0.05, 0.18], perturbed-view classification weight ∈ [0.90, 1.20], Siamese consistency weight ∈ [0.08, 0.20], NCE loss weight ∈ [0.01, 0.05], prototype loss weight ∈ [0.05, 0.16], density-view loss weight ∈ [0.001, 0.012] |
(continued in the next comment)
W1. Sources of the performance gains of QDGL
We thank the reviewer for examining the ablation results closely. We agree that, under the standard random split, the variant without the density path, "w/o dual path" in Table 4 in Section 3.4, is close to the full model, with Hit@1 gaps of 0.74, 1.42, and 0.69 percentage points on the three datasets. We would like to clarify that the quantum-inspired design of QDGL spans two components, namely quantum-inspired adaptive multimodal state fusion and vector–density dual-path relational learning. This variant removes only the density path, and its vector representation is still built by the quantum-inspired state encoding and adaptive fusion, so its gap to the full model reflects only the contribution of the dual path.
The first component can be examined separately with the training setup held fixed. Replacing the quantum-inspired states with real-valued spherical states lowers Hit@1 on CTD and PrimeKG by 14.09 and 14.88 percentage points, and setting the phase to zero lowers Hit@1 on PrimeKG by 9.28 percentage points (Table 4 in Section 3.4). These variants use the same features, two-view training, and loss as the full model. In addition, following the reviewer's suggestion, HeteroGNN + BCE, trained on the same pretrained features with the BCE loss only, reaches 66.57%, 54.90%, and 54.53% Hit@1 on the three datasets, as reported in Q1.
The contribution of the second component becomes clearer when information is incomplete. With 80% of features and edges masked, the full model keeps Hit@1 near 78% on ncRNADrug, whereas both single-path variants fall to about 64% (Figure 4 in Section 3.6), and on PrimeKG the full model exceeds the vector-only variant by 23.86 percentage points (Appendix Figure S8). The two paths also correct each other. In PrimeKG Case 3 of Appendix Figure S6, the true disease ranks third under the vector readout and fifth under the quantum-inspired readout, but first under their combination.
The revised manuscript moves the comparison between the two paths under missing information into the main text as Figure 4 in Section 3.6. Table 4 in Section 3.4 reports the ablations, Appendix Figure S8 reports the full comparisons under missing information, and Appendix Figure S6 shows the path-correction cases.
W2. Saturation of the benchmark
We thank the reviewer for this observation. We agree that the construction of CTD and PrimeKG leaves many random-split test triads recoverable from known pairs, with 71.42% of CTD test triads in PairSeen3. Following the reviewer's suggestion, the main comparison in the revised manuscript is therefore reported on PairSeen ≤ 1 test triads in Table 3 in Section 3.3, as detailed in Q3. In these triads, at most one of the three pairs appears in training, and prediction relies more on the modality features of the entities, which is the situation QDGL is designed for. In this setting, the relative Hit@1 gain of QDGL over the strongest baseline rises from 6.95% on the full CTD test set to 17.58% on PairSeen ≤ 1, and from 8.45% to 19.36% on PrimeKG.
Table 3 in Section 3.3 reports the comparison on PairSeen ≤ 1 test triads, and Appendix Table S5 reports the comparison on the full test sets.