- Rating
- 2(−1)
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces VeriCUA which is an agentic framework for evaluating trajectories of computer use agents. The authors find that their method substantially outperforms simpler baselines on benchmarks such as AndroidWorld, OSWorld and ScienceBoard and provide ablations for key components of the system.
Critical strengths
- The paper addresses and important and timely problem.
- the empirical evaluation and performance is strong: VeriCUA is evaluated on 3 diverse benchmarks (AndroidWorld, OSWorld and ScienceBoard) and significantly improves upon the provided baselines.
- the ablations in section 5 demonstrate the usefulness of the different components in VeriCUA.
- the presentation is good, the tables and plots are generally very informative.
Critical weaknesses
- Using agents for evaluation is potentially more expensive compared to the simpler baselines.
- The novetly remains somewhat unclear to me. Prior work such as [1] is cited but seems to overlap substantially with the work. Other important prior work such as [2,3,4] is not cited at all.
- The authors claim to contribute a new paradigm for verifying CUA trajectories. However, prior work such as [4] already introduces this paradigm.
[1] Agentic Reward Modeling: Verifying GUI Agent via Progressive Trajectory-Grounded Interaction, https://arxiv.org/abs/2602.00575
[2] The Art of Building Verifiers for Computer Use Agents, https://arxiv.org/abs/2604.06240
[3] OpenComputer: Verifiable Software Worlds for Computer-Use Agents, https://arxiv.org/abs/2605.19769
[4] ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaboration, https://arxiv.org/abs/2509.21823
Questions for authors
- The authors state in their AI-use statement that they used AI to identify relevant prior work. However, a substantial number of potentially relevant prior papers is not cited. Could the authors provide more context for how their work relates to the broader literature and if this has been missed by AI?