- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes an adaptive-group process reward framework for GUI agent RL training. The framework dynamically partitions a trajectory into subgoal groups using task instructions and agent responses, then evaluates each action at two levels: action-level and group-level, with a final refinement stage that revisits group scores in full-trajectory context. The resulting process reward shapes GRPO's step-level advantage. Experiments on show improvements over outcome-only GRPO, with all five critic stages conducted by a frozen Qwen3.6-27B.
Critical strengths
-
The adaptive grouping mechanism addresses a limitation of existing process reward methods. Fixed-window and milestone-based approaches either miss long-range evidence or fail to credit valid alternative paths, while dynamic grouping based on agent responses naturally aligns the evaluation scope with the executed trajectory's semantic structure.
-
The two-level evaluation design is well-motivated. By combining action-level execution correctness with group-level subgoal contribution through a product aggregation, the framework ensures that both local correctness and global usefulness are jointly necessary.
-
The paper validates the framework across three complementary dimensions: process-reward accuracy, step-level error detection, and downstream RL training.
Critical weaknesses
-
All five critics are conducted in a sequence by the same frozen Qwen3.6-27B. If an error occurs at an early stage. For instance, actions from different subgoals are incorrectly assigned to the same group during the grouping phase. How does this propagate to subsequent stages? Is there any mechanism to detect or correct such errors? The experiments and ablations only report end-to-end overall accuracy and results with entire stages removed, without analyzing the robustness of the pipeline to intermediate-step errors.
-
Action-level scoring evaluates each action using only subsequent actions within the same group as context. However, an in-group action's value may affect other group. For example, an action in group 1 enable a critical step in group 3. The current group-level refinement does consider cross-group dependencies by using later group results to reassess whether an earlier group was reused. If an action in group 1 has a cross-group impact on group 3, is there any mechanism to adjust that action's individual score?
-
Why only use Qwen3.6-27B as the critic model? What is the effectiveness if choose larger or smaller size model as judger?
-
The related work section discusses several GUI process reward methods, including GUI-Shepherd, GUI-PRA, ADMIRE, StainFlow, and GUIDE. However, the experimental evaluation includes only SeekJudge as a competing baseline, while the remaining approaches are all general model. This is insufficient to demonstrate the effectiveness of the proposed framework.
-
In table 3, this paper uses Qwen3.6-27B as the critic, while several baselines CUAjudge, SeekJudge and OSThemis employ smaller critic models (Qwen3-VL-8B and SeekJudge-9B). Without same-size baselines, the method's effectiveness remains unclear. Beside, the precision metric is not better than CUAjudge that use a smaller size critic model.
-
Please provide ablations experiments on OSworld benchmark.
Questions for authors
refer to weaknesses