- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents LEGO-MATH, a framework that synthesizes mathematical problems by composing DAG fragments extracted from existing solutions and updating affected downstream values. The generated problems achieve higher measured validity and solver resistance than the evaluated synthesis baselines. GRPO training on LEGO-MATH data mixed with LIMO achieves the strongest results among the compared methods on multiple mathematical benchmarks.
Critical strengths
- Structured problem synthesis. Composing explicit solution dependencies provides a concrete way to reuse existing reasoning structures and constrain synthesis, offering an alternative to generating entire problems directly.
- Demonstrated training value. The paper evaluates both synthetic data quality and downstream GRPO performance. The consistent gains over several synthesis baselines support the practical usefulness of the generated data.
Critical weaknesses
- Incomplete training controls. The experiments do not include training on LEGO-MATH data alone or adding unmodified seed problems to LIMO under a matched budget. These comparisons would clarify the contribution of composition beyond additional source data and its dependence on LIMO.
- Limited isolation of DAG and composition-depth effects. The w/o DAG baseline uses direct pair composition, whereas the full method supports iterative composition with additional matching and correction mechanisms. The comparison therefore does not isolate the benefit of DAG representation. Furthermore, increased solver resistance at greater composition depths does not establish increased RL training value.
Questions for authors
- How exactly is w/o DAG implemented? Are the generation models, verification budgets, and numbers of composed source problems matched to the full method?
- How does training on the 800 LEGO-MATH problems alone compare with training on the LIMO mixture, under comparable training budgets?
- How does LEGO-MATH compare with adding 800 unmodified seed problems to the same 800 LIMO problems?
- How does composition depth affect downstream GRPO performance? Do deeper compositions improve learning, or increase the proportion of rollout groups in which all answers are incorrect?
2 comments
A Gentle Follow-up Before the Discussion Deadline
Dear Reviewer B6Nf,
Thank you again for your time and consideration. As the discussion period is approaching its deadline, we would like to kindly follow up on our previous responses and manuscript revisions.
We would greatly appreciate it if you could take a moment to let us know whether any concerns remain. We would be happy to provide any further clarification if needed before the discussion closes.
If our rebuttal and revisions have addressed your concerns, we would sincerely appreciate your consideration of updating your assessment accordingly.
Thank you once again for your time and thoughtful consideration.
Best regards, Authors of Paper 37948
Response to Reviewer B6Nf
Thank you for suggesting that we test whether adding the original seed problems would yield the same gains.
Q1. Implementation and controls for "w/o DAG"
The "w/o DAG" variant directly asks the generator to merge two seed problems and then uses a strong solver for rejection sampling. Apart from the DAG pipeline, settings such as the generation model and verification budget are kept the same as in the full method. Both settings also use two source problems per composition.
Thus, the full method used to construct our training data and the "w/o DAG" variant are matched in the number of source problems. This comparison evaluates the DAG composition pipeline relative to direct pair composition.
Q2. Training with LEGO-MATH data only
We added a LEGO-MATH-only control using Qwen3-4B-Instruct-2507. Training on only 800 LEGO-MATH problems yields an Avg. of 64.29 ± 0.58, comparable to 63.95 ± 4.16 with LIMO alone. Combining the two datasets yields 70.37 ± 2.17.
All three settings are trained for 1 epoch, and LEGO-MATH only uses half as many training examples as the mixed setting. These results indicate complementarity between LEGO-MATH and LIMO, consistent with our goal of augmenting small, high-quality datasets.
Q3. Directly adding unmodified seed problems
We added a LIMO + Random Seeds control. Both this setting and LIMO + LEGO-MATH use 1,600 training examples and follow the same settings in the paper.
Directly adding the original seed problems yields an Avg. of 64.06 ± 2.57, comparable to 63.95 ± 4.16 with LIMO alone. Adding LEGO-MATH's composed problems yields 70.37 ± 2.17, exceeding the random-seed control by 6.31 percentage points. In this setting, composed data provides gains that simply adding source problems does not.
Q4. Composition depth and downstream GRPO
Figure 5 shows that difficulty increases as more DAGs are composed, with the same trend observed across two different solvers. This supports using composition depth to control the difficulty of synthesized problems.
All data used for downstream GRPO training in this paper is composed from two source problems, consistent with the baselines. The reported downstream training gains therefore correspond to this composition depth.
Due to time constraints, we leave experiments on how composition depth affects downstream GRPO performance and the proportion of all-wrong rollout groups to future work.