- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper aims at curriculum composition in reinforcement learning with verifiable rewards for visual reasoning, with the goal of disentangling two confounded effects. The authors introduce FACTORGRAPH-RLVR, a synthetic visual graph reasoning testbed built around a 3×3 factorial design that independently varies visual masking and reasoning load. Using this testbed, they compare four fixed curriculum distributions trained via GRPO with LoRA on Qwen3-VL-8B. The paper concludes that curriculum composition influences visual RLVR performance beyond what can be explained by optimizer-step budget or measured reward informativeness.
Critical strengths
-
The paper addresses a recognized problem, where performance gains from curriculum design are often attributed to better task selection, but they may instead simply reflect a higher rate of informative reward signals. Attempting to separate these two factors is a methodologically relevant goal.
-
The 3×3 crossed design of visual stress and reasoning stress is a useful diagnostic construct. By keeping the underlying relation tables identical across all nine cells, the testbed enables paired analysis of how performance gains vary across visual occlusion and reasoning depth, providing more granular insight than single-scalar benchmark scores.
-
The authors follow a frozen, preregistered evaluation pipeline with 28 model checkpoints, three test splits, four decoding conditions, and paired bootstrap confidence intervals. They explicitly separate development and confirmatory results, avoid outcome-based checkpoint selection, and report all planned comparisons including null and negative results.
-
The idea of using logged within-group reward dispersion to count informative training steps, and then matching checkpoints on this metric, is a creative attempt to control for differences in update signal frequency across curricula.
Critical weaknesses
-
The entire study is conducted on a single, highly stylized synthetic task: following numeric transition tables on rendered graphs with partial digit masking. This is essentially a symbolic formatting and arithmetic task with trivial visual components, and it bears little resemblance to real-world visual reasoning, multimodal understanding, or standard visual QA benchmarks.
-
The task primarily tests structured execution of explicit instructions, not abstract reasoning, visual comprehension, or generalization to natural scenes. All conclusions are therefore tightly bounded to this one specific task family; there is no evidence that any of the findings transfer to other VLMs, other reasoning tasks, or practical RLVR applications. For a conference paper, this extremely limited scope severely reduces the potential impact of the work.
-
The headline effect is surprisingly small in magnitude and critically reverses sign in one of three training seeds. The paired bootstrap interval for seed 49 lies entirely below zero, meaning that for that run, uniform training is reliably better than reasoning-heavy training. The authors’ preregistered criterion sets a very low bar; a result that flips direction across random seeds is not a reliable or generalizable finding.
-
The operation of informative training steps using a simple threshold on within-group reward standard deviation (σ_t > 10⁻⁸) is methodologically weak. This metric only measures whether rewards vary across rollouts, not whether the variation produces a meaningful gradient, a correct parameter update, or any improvement in policy.
-
Several key controls and comparisons are missing, limiting the interpretability of the results: The dense vs. exact-only reward ablation is only performed under the mixed-control curriculum, not under reasoning-heavy or visual-heavy curricula. Thus it is impossible to tell whether the benefit of dense reward interacts with curriculum composition, which is directly relevant to the paper’s core question.
-
The paper does not compare against any existing adaptive curriculum methods (e.g., difficulty filtering, variance-based sampling, exploration-aware curricula). It only compares a handful of fixed distributions, so it offers little practical guidance for RLVR curriculum design.
-
Synthetic visual reasoning benchmarks with programmatic generation and verifiable rewards already exist in many forms (CLEVR, PuzzleVQA, PuzzleCraft, VisualSphinx, etc.). FACTORGRAPH-RLVR adds a factorial masking/length manipulation, but this is an incremental variation, not a fundamentally new benchmark paradigm.
Questions for authors
Refer to Weaknesses part.