- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how multi-template learning and subsequent reinforcement learning affect reasoning behavior in text-to-SQL. Using two 7B backbones on BIRD, it compares template-balanced SFT/RFT and GRPO. The analysis incorporated template usage statistics, intervention of requested templates, reasoning functional profiles of full responses, held-out candidate evaluation. Among the four paths from supervision to GRPO, the greedy accuracy rate improved, while Pass@32 decreased. The authors interpret these findings as behavioral evidence of a shift from whole-template imitation toward task-useful reasoning organization.
Critical strengths
- The comparisons are transparent by setting matched training questions, fixed final checkpoints, shared evaluation and retention of failures.
- Using separate candidates for discovery and validation and pre-RL-only profile selection reduces selection bias in the utility analysis.
Critical weaknesses
- Pretrained models can already favor certain templates, so equal training counts do not guarantee equal use in greedy outputs. GRPO is also expected to make rewarded answers more likely. Given earlier findings on style concentration and answer coverage, the paper needs to explain more clearly what new insight it adds.
- It is unclear whether the model is actually combining reasoning steps more flexibly, or just switching templates or changing its wording.
Questions for authors
- What do we learn from this analysis beyond the expected effects of GRPO and the findings already reported by [1] and [2]?
- How can you tell whether the model is combining reasoning steps more flexibly, rather than just switching templates or changing its wording?
[1] Long Li et al. The Choice of Divergence: A Neglected Key to Mitigating Diversity Collapse in Reinforcement Learning with Verifiable Reward. ICLR, 2026. https://arxiv.org/abs/2509.07430
[2] Yang Yue et al. Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model? arXiv:2504.13837, 2025. https://arxiv.org/abs/2504.13837