- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Sibling and Self-Verification Policy Optimization, a framework for improving open-ended generation through self-teaching. Experiments on Qwen3-4B and Qwen3-8B across medical and scientific tasks show improvements over RGSD and GRPO, with additional ablation studies supporting the contributions of both components.
Critical strengths
-
The proposed sibling-conditioned distillation provides an interesting approach to incorporating information from multiple on-policy responses into dense token-level supervision.
-
The experiments demonstrate consistent improvements across multiple benchmarks and model scales.
Critical weaknesses
-
The paper only evaluates Qwen3-4B/8B in Non-Thinking Mode and lacks comparisons with stronger recent OPD/OPSD methods, particularly those combining RL with self-distillation. Evaluation in Thinking Mode would further strengthen the results.
-
The proposed method largely combines existing on-policy self-distillation and GRPO techniques with sibling-conditioned guidance and self-verification. While the combination is potentially useful, the individual components build heavily on prior work, and the paper does not sufficiently establish a substantial methodological advance beyond existing approaches.
Questions for authors
How does S²PO differ substantially from recent OPD/OPSD methods that combine RL with self-distillation? Why are these methods not included as baselines, especially given that adding distillation to self-verification yields only 0.71 and 0.53 percentage-point improvements in Table 2?