- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes Group-Relative Skill Optimization (GRSO), a framework for improving frozen language models by optimizing external natural-language skills. It aims to address two limitations of existing skill optimization methods: reflection over different questions can produce overly generic guidance, and evaluating an entire batch of edits together can reject useful edits alongside harmful ones. GRSO generates multiple trajectories for each training question and uses within-question reflection, contrasting successful and failed attempts when available, to propose itemized skill edits. Each question’s edit bundle is verified on its source question before accepted bundles are consolidated into a shared skill. Additional sampling and edit retries allocate more computation to difficult questions. The framework keeps model parameters fixed and does not require held-out validation during optimization. Experiments on retrieval QA, document understanding, and mathematical multiple-choice QA, using Qwen3.5-4B and Seed1.8, report best or tied-best accuracy across the six evaluated settings, with the largest improvements on the math benchmark.
Critical strengths
- The paper presents a clear and practical framework for optimizing external skills for frozen language models. The use of within-question trajectory comparisons and question-level edit verification is intuitive and enables selective retention of proposed updates.
- The approach avoids repeated full validation set checks, with reported reductions in training-token consumption.
Critical weaknesses
- The paper seems to use a wrong reference of the LiveMathBench benchmark. Based on the paper's description, it should be the LiveMathematicianBench following the SkillOpt paper, which evaluates multiple-choice questions.
- The paper shows the most significant improvements on the LiveMathBench benchmark compared to prior methods. However, based on Figure 2, the presented skills learned with GSPO include "Select the meta-option asserting a stronger result can be proven.”, which is a clear shortcut to this benchmark. The underlying benchmark, LiveMathematicianBench [1], constructs some questions by replacing the correct option with a distinctive statement that another option is correct but a stronger result can be proved. So the current performance on this benchmark could be using the shortcut rather than genuine generalization capability. The paper should redo the eval by removing this type of skill.
- Given one of the main limitations the paper identified is common-denominator bias, I would expect a more direct comparison of within-question reflection against mixed-question reflection while holding the remaining procedure fixed. The comparison with SkillOpt still mixed many other confoundings.
- The retained-update rates are difficult to interpret comparatively because GRSO and SkillOpt use different acceptance criteria and numbers of candidate bundles per step. A higher retention rate does not itself establish more useful learning. Accuracy-versus-compute curves would better substantiate the efficiency claim, complementing the costs already reported in Table 3.
- More implementation details should be provided for reproduction.
[1] He, Linyang, et al. "LiveMathematicianBench: A Live Benchmark for Research-Level Mathematical Reasoning with Proof Sketches." Third Conference on Language Modeling.
Questions for authors
See weaknesses.