- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
AceGRPO trains autonomous MLE agents with an evolving buffer of intermediate execution states and a sampler based on reward dispersion, improvement headroom, and recency. It optimizes single-step code actions rather than full trajectories. Ace-35B is evaluated on MLE-Bench-Lite, and a separate Ace-30B study compares training baselines and component ablations.
Critical strengths
- Reuse of execution states is well matched to expensive MLE training. The buffer turns both failures and partial successes into future starting points, and the curriculum is tied to observed execution outcomes.
- The held-out-competition evaluation and same-initialization Ace-30B ablations provide useful evidence beyond comparison with an untrained model. Reporting repeated evaluations and first-submission quality also helps characterize the improvement.
Critical weaknesses
- The interpretation of raw reward dispersion as a direct gradient-magnitude proxy is not established for standardized GRPO advantages. Away from the numerical stabilizer, rescaling a nonconstant reward group leaves its standardized advantages essentially unchanged. Potential may still be a useful sampling heuristic, but the stated gradient justification needs qualification and validation.
- The component study uses Ace-30B rather than the main Ace-35B, and matches update steps rather than measured execution cost. Since tasks have highly unequal runtimes, it does not fully establish that the main-model gain or training efficiency follows specifically from adaptive sampling under an equal cost budget.
Questions for authors
- How strongly does potential correlate with measured update utility or gradient statistics after GRPO normalization, compared with variance-only and uniform sampling?
- What are the Ace-35B component results and learning curves under equal execution-hours or total GPU-hours?
Thank you for the precise review. Below is our point-by-point response.
[W1] Raw reward dispersion as a gradient-magnitude proxy under standardized advantages
We agree and qualify the justification as requested: raw reward dispersion determines whether a group yields a reward-driven gradient, not how large it is. Under the population-standard-deviation convention in Eq. (3), G1∑i=1GA^i2=(σ+ϵ)2σ2≈1when σ≫ϵ.
We will reword this interpretation wherever it appears and qualify Eq. (5).
[W2 & Q2] Component evidence on a second base model; learning curves and measured cost
Repeating the component ablation on the 35B model was beyond our compute and time budget. The component evidence therefore remains the full Ace-30B study: Table 2 of the paper ablates both components in that setting, and the full run gains on six of the seven metrics of Table 1 over its own base and ties on Silver (Any Medal from 27.27% to 51.52%, HumanRank from 48.75 to 71.14; Table R1), the same pattern as Ace-35B. So the method is effective on both base models, and each components of AceGRPO is effective.
Table R1. The full Ace-30B run against its base at the matched 400-update budget.
Learning curves: Figure 5 of the paper gives the training dynamics of the submitted Ace-35B run (valid-submission rates and rewards by task type) over its 400 updates.
Component evidence: the effectiveness of the individual components of AceGRPO is shown by the experiments on the 30B model in Appendix B of the paper, and the full 30B run is in Table R1 above. Together with Table 1, this gives the same picture on two base models: each component contributes, and AceGRPO improves the base model on the MLE-Bench-Lite metrics in both settings.
We hope the corrections and the additional results address your concerns. If so, we would be grateful if you would consider adjusting your rating.