- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the flow from "knowledge injection" to "knowledge utilization" in LLMs. The main claim is that CPT allows the model to memorize injected knowledge almost perfectly, but does not automatically make the model recall/use this knowledge during reasoning; only SFT/OPD with explicit Recall demonstrations can open the "utilization gate." The authors further propose CUE, which adds recall-style prefixes to knowledge statements during CPT, improving KG and QG.
Critical strengths
The research question is important, and the idea is good. It attempts to study knowledge flow in LLMs by separating memorization and utilization.
Critical weaknesses
The experimental setup is not rigorous enough or somewhat strange. Details are in the Questions section.
Questions for authors
- Why choose an instruct model for CPT instead of a base model? How can one judge the impact of running CPT on a model that has already undergone post-training?
- Why is training conducted with a fixed number of updates? I understand that under this setting, different exposure rates correspond to different numbers of exposures per data point.
- Why is LoRA used for all training? The performance will certainly differ from full-parameter CPT/SFT. LoRA SFT is acceptable, but LoRA CPT is not a common practice. Is it possible that the model trained this way only supports probes with similar templates but does not truly internalize the knowledge?
- Could it be that the form of Rewrite SFT is somewhat strange, leading to poor results? What if one directly uses question-answer SFT without an intermediate reasoning chain, for example, "Q: What is the population of Maplewood? A: 3"? Based on my understanding of research in this area, after such training, for the soft-hidden knowledge defined in this paper, the model should be able to answer correctly.
- Could the effect of CUE simply be due to increased diversity in knowledge expression? It would be best to add a comparison experiment that rephrases knowledge without adding recall prefixes, or uses non-recall prefixes, so as to identify the true gain from the "recall" behavior.
- Is the evaluation of "utilization" overly dependent on explicit Recall? If the model internally uses knowledge but does not write out "Recall:", is it being underestimated? Can a measure of implicit utilization be added?