- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Population-Curated Policy Optimization (PCPO) for self-evolving algorithm-design agents. It is motivated by "in-context evolutionary stagnation", where OpenEvolve and ShinkaEvolve with Qwen3-8B underperform direct sampling, and by a conditional Improvement Chain proposition: training on one program can raise the likelihood of its neighbours. PCPO keeps a deduplicated per-instance population of verified programs ranked by reward and diversity, mixing on-policy GRPO with periodic off-policy updates on top-k elites. The authors demonstrate on Qwen3-8B that it improves HPWL by 1.54% on average over human-set parameters across 16 ISPD 2005/ICCAD 2015 chips, comparable to GPT-5.5. On 4 KernelBench Level-1 tasks it reports an 8.27× average speedup.
Critical strengths
The paper addresses an important question of how to escape in-context evolution stagnation.
Critical weaknesses
The biggest concern is that it is not clear anything is learned beyond a good schedule. The "algorithm" is one short adjust_learning_rate function over eight scalars, trained for 16 steps on 4 chips.
The stagnation diagnosis uses a weak setting: one small model as the only mutation operator and 16 to 64 rollouts, whereas AlphaEvolve and ShinkaEvolve were shown with frontier-model ensembles, and neither OpenEvolve nor ShinkaEvolve is run with GPT-5.5.
The experimental gains are difficulty to differentiate from noise. On the 12 held-out chips PCPO gains 1.33% over the default against 1.56% for GPT-5.5 best@16, a gap the paper concedes, and 1.54% against 1.64% over all 16 (Table 2).
Proposition 1 is a triangle inequality on log-probabilities and, as Section 5 concedes, says nothing about fitness.
ShinkaEvolve finds no valid placement within 16 rollouts on 5 of 16 chips (Table 1), and Codex-GPT-5.5 is 90.18% worse than the default on bigblue1 (Table 2). To me these look like harness failures, yet the paper reads them as consistent with its hypothesis. Table 6 also omits plain sampling at 64 rollouts, although Fig. 5c shows a best-of-64 Qwen3-8B sample on bigblue1 at 87.26, against 87.23 for PCPO.
Questions for authors
While I understand the authors may be resource constrained, but current experiment setup cannot back up the authors' claims empirically. Evolutionary search has very high variance, at the current experiment budget, it's impossible to differentiate any methodology gains from noise.