- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes DaVinci-Math, a pipeline that curates math problem-solving data jointly for midtraining, SFT and RL. Problems from 28 public sources are cleaned and deduplicated, while being filtered to prevent benchmark contamination. Each problem is then labelled by rule-based filters and an LLM classifier and routed to midtraining, post-training or to be dropped. The pipeline yields 62B midtraining tokens, 3.8M SFT trajectories and 39K RL prompts, which are used to train several models. The experiments show a good improvement on a small and weak base model that outperforms newer reasoners, while also achieving near-saturation of the benchmarks on a Qwen3-30B-based model. The authors have also performed numerous ablation studies to show the necessity of the entire pipeline and isolating for confounding variable.s
Critical strengths
-
The pipeline's motivation makes sense, and seems carefully developed, with diverse data sources, care against data contamination, deduplication, and selection methods. I also appreciate the paper's openness by providing the dataset during submission time. The paper is also clear and well-written.
-
The ablation studies are well designed, controlling for most variables in question, and motivating the need for all their design choices, including multiple seeds and confidence intervals.
Critical weaknesses
-
The paper presents no comparison to similar multi-stage training pipelines, which begs the question of whether a novel one is truly required. For example, Olmo 3 [1] presents an open data source that they use for their models, which could be used in-replacement of the one presented here (given the teacher for SFT is held the same), while DeReason [2] proposes a method to split data between SFT and RL stages (this one is not open from what I could understand but the method seems simple enough to implement). Some comparison would significantly strengthen the claims of the paper.
-
The contribution of distillation versus routing is unclear. From what I could ascertain, other models do not clearly describe their teachers, which might end up weaker than OSS-120B. This leaves open the question of whether the stronger teacher is not what drives the majority of performance (which is why it seems the authors picked a stronger one for the larger model).
References
[1] Olmo, Team, et al. "Olmo 3." arXiv preprint arXiv:2512.13961 (2025).
[2] Hu, Hanxu, et al. "DeReason: A Difficulty-Aware Curriculum Improves Decoupled SFT-then-RL Training for General Reasoning." arXiv preprint arXiv:2603.11193 (2026).
Questions for authors
-
(Future work?) Several works [3,4,5] highlight the importance of proof correctness contrasted to final-answer correctness. Given the pipeline focuses on verifiable objectives via filtering for SFT+GRPO rewards, did this impact the final models in terms of producing better answers but not necessarily good and correct proofs?
-
Can you compare the model with its associated teachers on the benchmarks? Given the importance of distillation during the SFT stage it is important presentation-wise to show the capabilities of the teachers themselves.
-
Please address the remaining concerns from the Weaknesses section.
References
[3] Petrov, Ivo, et al. "Proof or bluff? evaluating llms on 2025 usa math olympiad." arXiv preprint arXiv:2503.21934 (2025).
[4] Mahdavi, Hamed, et al. "Brains vs. bytes: Evaluating llm proficiency in olympiad mathematics." arXiv preprint arXiv:2504.01995 (2025).
[5] Zhang, Ziyin, et al. "Deeptheorem: Advancing llm reasoning for theorem proving through natural language and reinforcement learning." arXiv preprint arXiv:2505.23754 (2025).