- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
KGPFN combines local context and global context for knowledge graph link prediction. It uses NBFNet to encode graph structure and a PFN initialized from TabICL to predict candidate triples using positive and negative examples of the query relation.
Critical strengths
1.The distinction between local context and global context is clear and provides a reasonable motivation for the method. Local context captures the query-specific neighborhood, while global context provides relation-specific evidence from positive and negative examples.
2.The paper provides theoretical analysis of conditional message passing and an idealized bilinear surrogate. Proposition 1 shows how labeled support examples change the effective structural weights without updating the model parameters.
3.The paper analyzes inference time and memory costs, including context caching and chunking. Experiments on FB15k-237 report per-query latency and peak GPU memory, showing similar latency to KGICL with substantially lower memory usage.
Critical weaknesses
1.The ablation study does not sufficiently establish the contribution of relation-specific global context. Replacing the embeddings supplied to the PFN with random vectors, all-ones vectors, or embeddings saved at a selected epoch and kept fixed afterward would help asses how much the graph representations produced by the Contextual Graph Encoder & Feature Fusion module contribute to link prediction performance.
2.The paper initializes the PFN from TabICL but does not sufficiently justify this choice. Comparisons with other PFN models, such as TabPFN or LimiX, would clarify whether the results depend on TabICL or extend to other PFN models.
3.The comparison omits SEMMA and SCR, and KGICL is included only in the fine-tuned setting. Since KGICL also performs in-context learning for link prediction, its absence from W/o FT limits the comparison with a closely related method. Including these baselines under comparable evaluation settings would provide a more complete evaluation against existing KGFMs.
4.The improvements of KGPFN are modest: under W/o FT, KGPFN improves MRR over FLOCK from 0.392 to 0.396, while both achieve a Hits@10 of 0.560. Statistical significance tests are needed to assess these gains to avoid the variability of training.
Questions for authors
Please see the Weaknesses.