- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CORE, a non-parametric approach to adapting frozen language models. CORE compares successful and failed reasoning traces to extract reusable natural-language insights, validates them before adding them to an external memory, and retrieves them based on semantic relevance and estimated utility. The method is evaluated on four reasoning tasks, primarily using GPT-OSS-120B, with additional experiments on Qwen3.5-9B. Compared with GRPO, GEPA, episodic RAG, and MemRL, CORE achieves competitive or better performance in most low-data settings, with fewer rollouts and lower context overhead. Ablations suggest that both contrastive reflection and utility-aware retrieval contribute to the gains.
Critical strengths
- On GPT-OSS-120B, CORE achieves the highest mean accuracy in 9 of the 12 combinations of task and training set size. Additional results on Qwen3.5-9B provide further support for the approach. Although the methodological novelty is incremental, CORE has practical value as a way to adapt frozen models using a small number of training examples.
- CORE adds only about 920 context tokens per evaluation problem, compared with roughly 33,600 for episodic RAG and 32,700 for MemRL. This substantially lower context overhead is a useful advantage, especially given its competitive accuracy.
Critical weaknesses
- The evidence for contrastive reflection, a central contribution of the paper, is limited. In Section 5, reflection on failed traces alone improves accuracy by 23.4 percentage points, compared with 26.8 points for full CORE. The simpler variant therefore retains about 87% of the gain. Figure 4 reports only averages across tasks, without uncertainty estimates or per-task ablation results. Contrastive reflection appears to help, but it is unclear whether the additional benefit is consistent across tasks and runs.
- CORE validates candidate insights before adding them to memory, but there is no ablation that removes this filtering step; Appendix D only varies the number of validation attempts. The compute comparison is also incomplete: rollout counts include admission tests but exclude reflection calls, and total token usage is not reported for the ablation variants. This makes it difficult to separate the gains from contrastive reflection from those due to candidate filtering or additional computation.
Questions for authors
- Do the single-trace ablations use the same candidate-generation limits, admission tests, sampling strategy, and retrieval method as full CORE?
- Could you provide per-task ablation results and uncertainty estimates across runs? In particular, how consistent is the additional gain from contrastive reflection?
- What is the total token usage for each ablation variant, including reflection and admission testing?
- Have you evaluated a variant without admission filtering while retaining contrastive generation and utility-aware retrieval? Comparing these variants under the same compute budget would help clarify the contribution of filtering.