- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces AdaptEvo, a framework for rule-governed decision tasks with imperfect supervision. Its main contributions are Confidence-Adaptive GRPO (CA-GRPO), which adjusts the balance between outcome and process rewards based on reference confidence, and an Evolution stage that updates decision knowledge and process rubrics from recurring training failures.
The method is validated on an industrial multimodal content-moderation dataset with both In-Period and rule-shifted Out-of-Period test sets. Using Qwen3.6-35B-A3B, AdaptEvo reaches 61.9% ELA / 72.2% BDA In-Period and 59.5% / 69.5% Out-of-Period, outperforming standard GRPO. Additional comparisons examine fixed reward mixtures, checkpoint generalization, and evolved knowledge.
Critical strengths
The Out-of-Period evaluation and checkpoint analysis are informative. Rather than evaluating only on an IID test split, the paper considers a later-period setting with rule changes and tracks performance throughout training. The results show that standard GRPO degrades at later checkpoints while CA-GRPO maintains substantially better Out-of-Period performance
Critical weaknesses
- The proposed training methods are evaluated with only a single trainable backbone, Qwen3.6-35B-A3B, and almost entirely on a new benchmark introduced by the paper itself. The paper does not show that CA-GRPO or AdaptEvo transfers across model families or to an established external benchmark. In addition, the confidence mechanism requires multiple human annotations for each example, which may limit its applicability to datasets where such annotations are unavailable.
- The final AdaptEvo model simultaneously introduces evolved knowledge, an updated rubric, and additional policy training. Therefore, its improvement over CA-GRPO cannot be clearly attributed to knowledge evolution, rubric evolution, or simply extra optimization.
Questions for authors
- Do the authors have results for AdaptEvo or CA-GRPO on any additional trainable backbone beyond Qwen3.6-35B-A3B?
- How do the authors assess the generalizability of AdaptEvo and CA-GRPO to other datasets?
- Can the authors provide matched-compute results that isolate the contribution of the Evolution stage, in particular continued CA-GRPO with the original knowledge and rubric versus continuation with evolved knowledge and/or the evolved rubric?