- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents UltraLogic, a pipeline that generates verifiable logic-puzzle data with a ten-level difficulty ladder. It also proposes Bipolar Float Reward (BFR): reward 1 for a fully correct answer, and S−1 otherwise, where S is a partial score. Qwen3-8B and 14B are trained with GRPO. The paper reports gains on AIME, HMMT, BBH, BBEH, and ARC-AGI. It also claims that the best training difficulty grows with model size, and that BFR beats binary and float rewards.
Critical strengths
The data problem is real. Separating the logic core from the text is a sound design. The pipeline is largely automated. The appendix is detailed. The evaluation includes out-of-domain benchmarks. The authors plan to release the code.
Critical weaknesses
BFR has little novelty. The paper shows that R_BFR + 1 = S + 1[S=1]. GRPO normalization ignores the shift. So the "bipolar" part and the "Non-negative Reward Trap" do nothing by themselves. The trap is never defined or tested. What remains is partial credit plus a bonus. Appendix F does not help choose c. The simulation shows nearly the same gap for c from 0.5 to 2. The reward ablation is weak. Graded Float is much worse than Binary on AIME24 (76.9 vs 81.7). The paper does not explain why. The BFR gains are small. The efficiency claim compares epoch-1 and epoch-2 checkpoints, not equal compute. Reward curves with different scales are not comparable. "Difficulty Matching" is over-claimed. The "scaling law" uses only two model sizes and three bands. Difficulty is calibrated on other strong models, not on the trained ones. The trained model's pass rate per band is never measured. Hard bands also have longer outputs, so truncation at 32K could explain the instability. This is not ruled out. Baselines and transfer evidence are thin. The only baseline is LogicPro, which gives almost no gain, and the reason is untested. There are no results for SynLogic or Reasoning Gym. There is no control with generic math RL data. RL on any data might fix length or format and raise AIME scores. The benchmark-overlap cleaning is not described. Changes of 0.1–0.6 on ARC-AGI are noise. The headline claims go beyond the experiments. The paper claims "recursive self-improvement", but all runs use fixed datasets. The abstract says "hundreds of task types", but only 100 are released and 50 are used. LLM-written solvers have no measured error rate. The paper itself reports collapse when only 1–3 tasks were wrong.
Questions for authors
- Can you add a generic RL-data baseline and SynLogic under the same budget?
- Why does Graded Float hurt? Can you ablate the bonus weight in actual training?