- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes TOME for inductive link prediction on knowledge graphs. TOME encodes the neighborhood of the query entity with recursive message passing and is trained with episodic meta-training. The query relation embedding is added to every message and to the attention input. The authors present this "pre-aggregation query conditioning" as a contribution and argue that it suppresses query-irrelevant signals during propagation. Experiments cover the 12 inductive splits of WN18RR, FB15k-237, and NELL-995, together with their transductive setting.
Critical strengths
The WN18RR results are notably higher than the competition. On the four inductive WN18RR splits, TOME's MRR is between 3.8 and 14.7 points higher than the best baseline (Table 1).
Critical weaknesses
-
The premise that "query-irrelevant" information should be suppressed is not substantiated. The paper motivates the method by the need to suppress "irrelevant signals" and "topological noise" during propagation. This is a claim, not an established fact, and the paper should define what counts as irrelevant and show evidence that suppressing it helps. Information that is not directly relevant to the query can still give useful context about the entities involved, so propagating it is not harmful in general.
-
The novelty of the contributions is unclear, and related work is missing or imprecise. The "Pre-Aggregation Query Conditioning" contribution claims that injecting the query relation into message construction is new. Query-conditioned message passing is well established: e.g., NBFNet , ULTRA, and other prior query-conditioning approaches are not discussed as such. Similarly, related work on meta-training are not well described, and it is unclear how the proposed episodic meta-training differs from it.
-
The source of the improvements is unclear. The paper's own ablation (Table 5, two splits, single run) suggests that most of the gain comes from the episodic meta-training rather than from the query-conditioned messages. Applying the meta-training to plain RED-GNN raises WN18RR V1 MRR from 0.693 to 0.807, close to full TOME (0.836). Without meta-training, TOME (0.689) is no better than RED-GNN (0.693). Since it is unclear what in this meta-training is new (weakness 2), it is not possible to say which new element produces the gains.
Questions for authors
- How does an existing query-conditioned model perform when trained with existing meta-training approaches on the inductive splits? How does this compare with TOME?
- What exactly in the episodic meta-training differs from existing meta training approaches?
- Can the ablation in Table 5 be extended to all 12 splits, with results over multiple seeds?