- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes GOLD-LP, a generation-free data selection method for reinforcement learning with verifiable rewards (RLVR) on visual multiple-choice questions. For each candidate, the initial VLM performs one forward pass under a fixed answer prefix and scores the log-probability of the correct option letter. The pool is then ranked by this score, and a contiguous interval (ranks [500, 1500) of 3,023 for the main variant, GOLDLP-MATCH) is retained for standard GRPO training. The paper argues that existing outcome-based selectors require costly front-loaded generation (48,368 responses here, about 21.5% of one training run), whereas GOLD-LP requires none. Experiments on Qwen3-VL-8B-Instruct with DOCCI-derived questions show that GOLDLP-MATCH obtains the highest mean accuracy among the evaluated 1,000-example selections, with a 1.35-point gain over random selection on a geometry transfer set. A placement ablation suggests that the retained interval matters as much as the score. However, the in-distribution gain over random is not significant, full-pool training remains clearly stronger in distribution, the geometry gain sits exactly at the adjusted significance threshold, and the second-backbone experiment reverses on geometry. In addition, the score is close to existing confidence-based selection, and the paper does not show that selection brings a practical benefit when the training budget is fixed. Therefore, while the question is relevant and the experimental reporting is careful, the novelty and the strength of the empirical evidence are insufficient.
Critical strengths
- Relevant problem. The paper makes the cost of obtaining a selection signal explicit and reports it alongside downstream accuracy, which prior work rarely does.
- Simple method. GOLD-LP needs one forward pass per candidate, no generation, and no change to the GRPO objective.
- Careful evaluation protocol. Answer-position balancing, rotation-averaged evaluation, paired bootstrap over items and runs, Holm correction, and final-checkpoint evaluation are all well above the norm in this area.
- Clean placement ablation. GOLDLP-MATCH and GOLDLP-HARD share the same score, subset size, and training budget, so their comparison isolates the effect of the retained interval.
- Transparency. The supplementary material provides code, selected subsets, per-run evaluation files, and statistical reports, which makes the claims checkable.
Critical weaknesses
- The novelty is limited. Ranking examples by gold-label confidence is established (e.g., Dataset Cartography, UFO-RL), and retaining an interior band of a ranking is the idea of Moderate Coreset. For single-token answers, the paper itself shows that the ported UFO-RL confidence reduces to the same score, so the only methodological difference is the band location.
- The band location is not principled. The offset L = 500 was chosen to match the never-solved coverage of a probe-based arm on this specific pool. The paper gives no reason to expect it to transfer to other pools, models, or budgets, and no sweep over offset or width is reported.
- The main empirical evidence is weak. The in-distribution gain over random is not significant (95% CI [−0.21, 5.33], Holm p = 0.635). The headline geometry gain has Holm p = 0.0500, computed within a comparison family assembled after the results were seen. According to the supplementary pre-registration, the primary metric was in-distribution accuracy, and GOLDLP-MATCH was framed as an equivalence test against a probe-based arm, not as superiority over random.
- The random baseline is weak. Only one random subset is drawn and reused across all three runs, so variance from subset sampling is not captured. Its geometry standard deviation (0.21) is the smallest among the three-run arms, which partly drives the geometry interval.
- Cross-backbone evidence does not support the main claim. On Gemma-3-4B, the geometry ordering reverses. The in-distribution gain (+3.44) is of the same size as the unexplained 2.52-point difference between two evaluations of the same Gemma random checkpoint.
- The practical benefit of selection is unclear. Because all arms are trained for the same number of steps, selecting a subset saves no training compute (about 4 hours per run for every static arm). Full-pool training costs nothing to select, is significantly better in distribution, and is statistically indistinguishable on geometry.
- The contribution of the score is not isolated from the interval. The score has a Spearman correlation of about 0.81 with the 16-sample pass rate, so it is largely a cheap proxy for it. The paper does not compare against the same retention rule applied to the pass-rate ranking, against coverage-matched random selection, or against a low-cost probe with one or two samples per item.
- The scope is narrow. The method applies only to four-option multiple-choice questions with single-token answers. All results come from one DOCCI-derived pool of about 3K items and one geometry transfer set. The untrained model's geometry accuracy is not reported, so it is unclear how much the training moves this benchmark at all.
- The writing needs improvement. The key distinction from UFO-RL and Moderate Coreset, namely that only the band location is new, is stated only in the related work (Section 5), near the end of the main text. It should be made explicit in the introduction so that the contribution is not overstated. In addition, the text relies heavily on colons and rhetorical questions to join or introduce clauses (e.g., "Choosing them is itself costly: selectors that ...", "We introduce GOLD-LP: one forward pass per candidate ...", "can a useful subset be identified without generating a single response, and how much accuracy can such a subset deliver?", and the question-style paragraph headings in Section 4.3). This is not conventional academic writing and makes the paper harder to read. Using complete declarative sentences would improve clarity.
Questions for authors
- Can the authors report the untrained Qwen3-VL-8B geometry accuracy, and results with several independently drawn random subsets?
- What happens if the same rank interval, or a coverage-matched interval, is taken from the 16-sample pass-rate ranking instead of the GOLD-LP ranking? Does GOLD-LP match it at lower cost?
- How sensitive are the results to the band offset and width (e.g., L ∈ {250, 500, 750} and B ∈ {500, 1000, 1500})?
- Which analyses were pre-specified? Why is the geometry result, which does not appear in the pre-registration, presented as the main evidence?
- Is there any setting (e.g., a smaller training budget, a larger pool, or epoch-matched training) in which GOLD-LP selection outperforms full-pool training at equal compute?