- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This work studies how to balance parametric and contextual knowledge in retrieval-augmented generation (RAG). The authors propose SPARK, a lightweight framework that adaptively regulates the contribution of each FFN layer through input-dependent participation gates. Instead of modifying the backbone parameters or suppressing predefined knowledge-related layers, SPARK learns these gates using GRPO with answer-level rewards while keeping the backbone frozen. The authors construct training examples that encourage the model to rely on parametric knowledge when the retrieved context is misleading and follow contextual evidence when its internal knowledge is incorrect. Experiments on MRQA, ConfiQA, and MMLU demonstrate improvements in question answering while largely preserving general capabilities.
Critical strengths
-
The paper is clearly written, with a well-organized presentation of the motivation, methodology, and experimental results, making the main ideas easy to follow.
-
SPARK is lightweight and parameter-efficient, as it freezes the backbone and only trains a small number of gating parameters. Learning the participation policy directly from generation-level feedback, without requiring explicit supervision for how parametric knowledge should participate, is an appealing design choice.
-
The experiments cover multiple QA datasets, model sizes, and model families. The ablation studies also examine the contributions of the faithfulness reward, format reward, and regularization, providing useful evidence for the effectiveness of the proposed framework.
Critical weaknesses
-
My main concern is about whether the reward function adequately captures contextual faithfulness. The method primarily relies on exact-match agreement with reference answers, which measures answer correctness but does not necessarily establish whether the model actually relies on the appropriate evidence. Evaluating evidence-grounded generation more directly would strengthen the paper's central claim.
-
The construction of knowledge-conflict examples may not always reflect genuine conflicts. In particular, selecting a semantically related passage that does not contain the model's parametric answer does not guarantee that the passage contradicts that answer. This raises concerns about whether the training data reliably teaches the model to distinguish misleading evidence from incomplete context.
Questions for authors
see weakness