- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes VISTA, a framework for automatically synthesizing verifiable training tasks for GUI agents without relying on human annotations or stronger teacher models. The framework is evaluated using two backbone models, Qwen3-VL-8B-Instruct and Qwen3.5-9B, resulting in VISTA-8B and VISTA-9B, respectively. The proposed method produces approximately 3.8K validated tasks across the two backbones. Experimental results demonstrate improvements on several GUI benchmarks.
Critical strengths
- The paper tackles an important challenge in GUI agent training: how to obtain scalable and reliable supervision without relying on human annotations or expensive teacher models. The idea of jointly generating tasks and executable evaluators is promising.
- VISTA combines task generation, verification, and RL training into a relatively straightforward pipeline. Reusing verified tasks and evaluators is also a useful design for scaling up data generation.
- The method consistently improves both backbone models on OSWorld-Verified and WindowsAgentArena-V2. The improvements on OSWorld-G and ScreenSpot-Pro also suggest some generalization beyond the training tasks.
Critical weaknesses
-
The self-curriculum claim is not well supported. The growing task and evaluator pools do not necessarily indicate increasing task difficulty. Moreover, continuous GUI training might even degrade the model’s task-generation or evaluator-generation abilities, raising doubts about whether VISTA truly achieves policy-adaptive curriculum learning.
-
Task quality is not sufficiently evaluated. Human evaluation mainly checks task validity, but valid tasks are not necessarily useful. The model may generate simple tasks that provide little learning value. Task difficulty and training value remain unclear.
-
The baseline comparisons are insufficient. The paper lacks direct comparisons with stronger CUA agents that have undergone dedicated RL post-training, making it difficult to fully assess the advantages of VISTA’s synthetic data. The data advantages of Vista need to be demonstrated to enable it to surpass work using other data strategies for reinforcement learning.
-
Evaluator correctness is not sufficiently guaranteed. Checking executability and semantic relevance does not guarantee that evaluators capture all task requirements or provide reliable rewards.
-
Scalability depends on existing verification infrastructure. VISTA relies heavily on predefined, environment-specific functions and APIs. Its effectiveness on new applications without such infrastructure remains unclear.
Questions for authors
-
Why not use stronger models to generate tasks for smaller models? This is a common approach, so a comparison with stronger teacher-generated data would be helpful. If VISTA is more effective, could the authors also validate it on state-of-the-art models?
-
How is task quality and diversity ensured? Semantic similarity filtering can remove duplicates, but it does not guarantee diversity in task difficulty, complexity, or learning value. Could the authors provide further analysis?
-
Regarding the Task-Evaluator Relevance Check, this relevance judgment is still performed by the model and does not form an independent and reliable correctness proof.
-
For Execution-Based Verification, how does VISTA distinguish task infeasibility from limited agent capabilities? If the agent fails during verification, how can the framework determine whether the issue is the agent’s ability, an incorrect setup, or a flawed evaluator?
-
How do the authors ensure that generated evaluators provide correct rewards? An evaluator may be executable and semantically relevant while missing important requirements.
3 comments
Responses to Reviewer c3sQ (part 2/3)
W2, Q2: Could the tasks be valid yet provide little learning value?
Validity alone does not guarantee learning value. Our evidence comes from evaluating the resulting policies on tasks with independent benchmark evaluators. OSWorld-Verified and WindowsAgentArena-V2 assess task completion using their own success criteria, rather than VISTA's synthesized training evaluators. Both backbones improve on these benchmarks, including transfer from Linux-based synthesis to Windows environments.
Furthermore, Table 5 in the paper draft shows consistent improvements on an independently curated set of 100 held-out tasks across successive policy checkpoints. These results provide additional evidence that the synthesized supervision supports learning beyond the training tasks.
Regarding task complexity, Tables 12-13 report accepted tasks across ten software domains. For the 8B generator, estimated mean interaction lengths range from 10.51 steps in Thunderbird to 22.74 steps for multi-application tasks. Figure 6 additionally illustrates a task requiring multiple spreadsheet modifications while preserving unrelated cell values. We do not infer individual task difficulty or marginal learning contribution solely from these statistics.
W3: What do the baseline comparisons establish?
Our comparisons address two different objectives. For final agent performance, Table 6 compares VISTA with UI-TARS, OpenCUA, ScaleCUA, GUI-OWL, and DART-GUI. VISTA-9B achieves 45.68% on OSWorld-Verified, exceeding DART-GUI-7B (42.13%), the strongest comparator reported in the table.
For training supervision, Figure 4 compares VISTA against SFT on AgentNet, one of the few publicly available, large-scale human-annotated GUI datasets suitable for training computer-use agents. Unlike VISTA, AgentNet provides demonstration trajectories without interactive environments or executable evaluators, naturally supporting SFT rather than outcome-based RL.
To make the comparison meaningful, we match the number of training tasks as closely as possible and use the same backbone models and optimization steps. The different supervision formats prevent exact matching of rollout exposure and compute. Therefore, Figure 4 compares the practical effectiveness of these training pipelines rather than isolating intrinsic data quality. O
Responses to Reviewer c3sQ (part 3/3)
W4, Q3, Q5: Why trust a reward when the model also judges evaluator relevance?
We agree that model-generated relevance judgments alone cannot guarantee evaluator correctness. This motivates our independent human audit, which explicitly examines evaluator completeness and false-positive/false-negative behavior.
As described in Section 3.3, three experts independently audited 200 candidates across all ten domains, assessing task feasibility, setup correctness, task–evaluator relevance, evaluator completeness, and potential evaluator errors. Their majority judgments agreed with the automatic filtering decisions in 184 cases (92%). The pipeline incorrectly accepted 12 candidates (6%) and rejected four valid candidates (2%), as reported in Table 3b.
Importantly, the 92% agreement measures candidate admission decisions, not per-rollout reward accuracy. These results characterize the reliability and remaining limitations of our verification pipeline. The independent downstream benchmark evaluations further demonstrate that the resulting supervision remains useful despite residual verification errors.
Q4: Can VISTA distinguish an infeasible task from one the actor failed to solve?
A failed rollout alone cannot reliably distinguish task infeasibility from insufficient actor capability. VISTA therefore combines static checks for malformed code, invalid arguments, and unavailable APIs with environment-based verification (Appendix A.1).
When a candidate cannot pass verification, it is excluded from the training pool, regardless of whether the failure results from task infeasibility or the current actor's limitations. This conservative admission criterion may reject feasible tasks beyond the actor's current capabilities. We therefore interpret rejected candidates as failing the admission criteria, rather than necessarily being infeasible.
W5: What does "a single small VLM" assume about verification infrastructure?
VISTA assumes access to an interactive environment that exposes sufficient state for executable verification, together with an initial function catalog. We refactor OSGym's setup and evaluator utilities into reusable Python function interfaces, from which the model can construct new task-specific evaluators.
Appendix A.1 describes the validation of generated code through parsing, signature checks, and execution. Tables 12-13 report 937 and 1,565 accepted evaluators for the 8B and 9B backbones, respectively. Thus, while VISTA does not eliminate the need for environment instrumentation, it reduces the need to manually author a separate evaluator for each generated task. Limited state accessibility remains an important boundary of the approach.
We hope the additional synthesis statistics, intermediate checkpoint evaluations, and fixed-pool ablations address the reviewer's concerns regarding self-curriculum. Together with the human audit and independent downstream evaluations, these results support our central finding that 8B–9B-scale VLMs can generate verifiable supervision that improves their own GUI performance, while also providing evidence for the benefit of jointly evolving task and evaluator pools.
Responses to Reviewer c3sQ (part 1/3)
We thank the reviewer for their thoughtful review. We would like to emphasize that the central question of VISTA is whether a single 8B–9B-scale VLM can generate verifiable supervision that improves its own desktop GUI capabilities, without relying on a stronger external teacher. We appreciate the reviewer's recognition of the downstream improvements. We further provide additional synthesis statistics, intermediate checkpoint evaluations, and controlled ablations to address the concerns.
Using a stronger teacher would address a different research question. If a larger model generates tasks and evaluators for an 8B student, improvements in the student demonstrate its ability to consume externally generated supervision, rather than its ability to generate useful supervision itself. VISTA instead assigns task creation, verification, and GUI action to the same 8B–9B-scale backbone within each run. This procedure improves OSWorld-Verified from 30.98% to 35.43% for Qwen3-VL-8B and from 40.95% to 45.68% for Qwen3.5-9B. Both backbones also improve by +4.25 percentage points on WindowsAgentArena-V2. A stronger-teacher comparison would help quantify the additional benefit of larger generators, but our primary finding is that useful self-generated supervision is already achievable at the 8B–9B scale.
VISTA's self-curriculum combines verification-driven pool evolution with iterative policy optimization. Accepted task–evaluator pairs are incorporated into retrieval pools, and the updated policy is used for subsequent synthesis rounds. To further validate this process, we provide evidence from three perspectives.
(1) Task synthesis dynamics. We report per-round synthesis statistics below.
Both backbones exhibit declining task acceptance rates (8B: 58.3% -> 24.5%; 9B: 60.6% -> 27.9%) alongside increasing average task-instruction lengths (8B: 46.9 → 60.1 tokens; 9B: 48.0 -> 68.2 tokens). These trends are consistent with increasingly selective synthesis as the pools expand. Longer instructions may reflect more elaborate task requirements, although we do not treat instruction length as a direct measure of difficulty.
(2) Progressive policy improvement. To examine whether the policy improves throughout self-curriculum training, we manually curated a fixed held-out set of 100 GUI tasks spanning browsers, office applications, coding tools, media, and file-editing software. This set is separate from the synthesis pools and downstream benchmarks.
Both backbones improve consistently across successive checkpoints, with overall gains of +26.0 and +32.0 percentage points. These results provide direct evidence of progressive policy improvement during the iterative synthesis and training process.
(3) Contribution of evolving pools. We additionally conduct fixed-pool ablations under the same RL training budget. We compare fixed task/evaluator pools, evolving tasks with fixed evaluators, and jointly evolving task/evaluator pools (VISTA-Full), using task pools of comparable scale.
Compared with fixed task and evaluator pools, VISTA-Full improves OSWorld-Verified by +2.77/+1.94 points and WAA-V2 by +0.95/+3.55 points for the 8B/9B backbones. Furthermore, enabling evaluator-pool evolution alongside task-pool evolution improves performance across all four comparisons. These results provide empirical support for jointly evolving task and evaluator pools, although they do not separately isolate the contribution of generator checkpoint updates.