- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates whether inference-time benefit can be internalized into a model that reasons directly in the target language. The authors propose CMOPD an online policy distillation where the privilege information is multiple language versions of the same problem. Therefore, the logits of the high-resource language reasoning is distilled into the low-resource language logits. At inference time, we simply sample the low-resource language model. Experiments on Qwen3 models and two high-resource languages with four low-resource languages show the effectiveness of the method.
In terms of method, given a target-language problem, the student first samples a reasoning trajectory and then a frozen teacher evaluates the same trajectory under each privileged high-resource language information. The internalization is learnt with the average KL divergence for each token and languages.
The experiment section train different Qwen3 models with LoRAs on the COPSD-AfriMGSM dataset (500 problems per language). Each solution is translated into chinese, spanish, and french using Qwen3-4B. Trained models are evaluated on 250 problems in Swahili, Igbo, Yoruba, and Amharic. The baseline methods are the base model, GRPO and COPSD (1 language). Results show that CMOPD outperform the baseline and slightly COPSD (which uses only english instead of english and chinese used as privilege information). Authors ablate what is the best strategy to integrate two high-resource languages (mix batches) and leverage the teacher predictions (logit mean averages) - nothing surprisingly and pretty known strategies.
The method relies heavily on translation, but the translation quality is not evaluated (Qwen3-4B is when Qwen3-8B is included in the experiments). As a consequence, translation errors could propagate into the distilled student. Additionally, training sets are small (and LoRA is used) compared to larger datasets and full fine-tuning. Moreover, it is unclear whether the benefits transfer to other domain like coding.
Overall, this paper is well-written with an incremental method over OPSD (using two languages instead of 1), the gains are modest, and it is unclear whether the method generalizes to other domain. More importantly, the translation quality is not studied.
Critical strengths
Elegant method for test-time multilingual reasoning (especially low-resource languages). Well-written paper.
Critical weaknesses
novelty, limited gains, lack of translation evaluation.
Questions for authors
Could you experiment with another model family? Could you analyze the quality of the translation?
Strengths
The paper asks a clear question: can the benefits of multilingual reasoning be built into training so that a model can answer directly in the target language? The approach is intuitive, and the experiments cover several model sizes and languages. The paper also looks at differences between language views and reports training costs. On 8B Swahili, CMOPD improves pass@12 by 4.8 points, with an additional training cost of about 2.8%.
Main Concerns
Each setting uses only one training run, and each language is tested on just 250 problems. The paper does not report uncertainty, so it is hard to know whether the gains are reliable. The 1.7B average gain is only 0.2 points and could be due to random variation; CMOPD also performs worse in 4 of the 12 model–language comparisons.
The paper compares a +4.8-point gain from training with a +4.4-point gain from multilingual reasoning at inference. But the two gains use different baselines, and inference-time synthesis requires multiple model calls. This comparison alone does not show that training has “internalized” the benefit of multilingual reasoning.
It is also unclear whether the gains come from cross-lingual information or simply from averaging multiple predictions. The translations used for training were generated by Qwen3-4B, but the paper does not separately test the effect of translation quality.
Questions for the Authors