- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes VAKE, a two-stage RL framework for improving access to parametric knowledge in LLMs. In Priming, the model inserts bridging triples into a retrieved subgraph, and a frozen answerer provides the reward. In Reasoning, the model learns to answer directly using the capability developed during Priming. Experiments across seven QA benchmarks show consistent gains over existing prompting and RL baselines.
Critical strengths
-
VAKE introduces a creative two-stage training framework that separates explicit knowledge elicitation from direct answer reasoning.
-
The motivation is meaningful: LLMs may contain relevant facts in their parameters but fail to recall them when answering directly.
-
The experiments are broad and support the paper’s main claim that VAKE improves access to parametric knowledge. The authors evaluate across multiple benchmarks and model scales, and include attribution analyses and ablations.
Critical weaknesses
-
The main results show that VAKE outperforms Self-Ask, RECITE, Unlock, and GRPO, but the paper does not compare their inference costs. Since VAKE first generates triples and then reasons over them, reporting measures such as generated token length or computation cost would help assess its overall advantage.
-
Table 3 shows that the share of inserted triples attributed to model parameters is 95.0%, 95.8%, and 80.3% for Qwen3-0.6B, 4B, and 8B, respectively. The drop for the largest model is unexpected and seems at odds with the common expectation that larger models store more factual knowledge. The authors should explain this result.
-
VAKE’s training depends on the frozen answerer providing a reliable reward based on the augmented subgraph. However, even when the subgraph contains the necessary facts, the answerer may hallucinate or fail to answer correctly, resulting in a misleading negative reward. The paper does not evaluate how sensitive the framework is to this issue, which is important for understanding whether VAKE can be trained reliably.
Questions for authors
See above.