- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper shows that VLMs often solve the same geometry problem in one view but fail in another. It builds a paired-view geometry dataset and proposes MIRROR. MIRROR picks, for each problem, the view the model currently solves best as a teacher, and trains the weaker views with GRPO plus a distillation term toward that teacher. On Qwen3-VL and GLM-4.1V models, it reports gains over single-view and mixed-view GRPO on ODA-Val, GeoInt, and MathVerse.
Critical strengths
- A good testbed and a clean method. Showing the same problem in different views gives a controlled way to study cross-modal failures, and the paper shows that no single view is always best. The student always generates its own answers, and the teacher view only scores them, which avoids copying information the student cannot see. A slowly updated teacher is shown to be necessary for stable training.
- Sound experimental practice. The experiments use current models from several families, add a second domain (charts), and report compute costs honestly. They also include a useful negative result: simply mixing views in GRPO does not transfer reasoning between them.
Critical weaknesses
1. The closest prior work is not cited, which narrows the contribution. arXiv 2510.22836 (Oct 2025) already distills from the model's own full-text view into its image-dependent view inside RL, with the same loss weight (0.01), on geometry and MathVerse. This is similar to MIRROR with a fixed text teacher. TIGER (ICML 2026) already selects problems that are solved as text but failed as images and trains on the image version with GRPO, which closely matches how ODA-Data is filtered. Neither is cited or compared. This is consequential because what remains new is choosing the teacher view per problem and the slowly updated teacher, so the paper's value depends on showing that these matter.
2. The remaining contribution, choosing the teacher per problem, is not established. Adaptive selection beats the best fixed teacher by only about 2 points on ODA-Val, and it loses on MathVerse and on GeoInt pass@16. All results are single runs, and the distillation weight was chosen on the test sets. About half of the time there is no teacher at all, and the image view acts as teacher only about 5% of the time, so the "reciprocal" transfer is mostly from views that contain the text. The headline consistency gain is measured on the training problems. This is consequential because, without evidence that per-problem selection beats a fixed teacher, the paper's distinctive claim is unsupported.
Questions for authors
- How does MIRROR compare with the recipe of arXiv 2510.22836 and with TIGER, under identical data and backbone?
- Can you report multi-seed results for the adaptive vs. fixed-teacher ablation (Table 3), with the distillation weight chosen without the test sets? Please also give the teacher distribution per student view, and both-view solvability on held-out data.