- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents Infinite-Dreamer, a synthetic data generation framework for training mobile GUI agents. It models GUI transitions as image-editing operations, using structured delta-text to generate high-fidelity next-screen images and multi-step imagined trajectories. The synthesized data is then used to fine-tune Qwen3-VL into Infinite-Actor.
Critical strengths
The image-editing world model produces relatively high-quality GUI transitions, preserving layout, text, and other visual details better than the compared general-purpose image-editing baselines, including in multi-step rollouts.
Critical weaknesses
1.The paper motivates synthetic data as a more scalable alternative to real trajectory collection, but does not provide an end-to-end cost comparison. Given the relatively high inference cost of the image-editing world model, it is unclear whether generating and filtering synthetic trajectories is actually cheaper than collecting real interactions at comparable scale.
2.Infinite-Actor improves task success on AndroidWorld and MobileWorld, but the results on AndroidControl-Curated are mixed: Step SR decreases in three of the six settings, and coordinate grounding accuracy drops in most settings. The paper also does not compare synthetic and real data under the same training-data budget, making it difficult to determine whether the proposed synthetic data is more effective or data-efficient than real trajectories.
Questions for authors
Could the authors compare synthetic and real trajectories under the same training-data budget? This would make it easier to assess the actual data efficiency of the proposed synthesis pipeline.
2 comments
Thank you very much for your comment. We have supplemented relevant experiments to compare the gap between synthetic data and real data, and reported the required costs:
-
Synthetic data is scalable, cost-effective, and complementary to real data Cost Report show that our pipeline costs only $0.032 per step, 9.6–11.9× less than OpenMobile and manual collection from AndroidControl and AITZ and supplementary experiments show that synthetic data can achieve a higher success rate than real data at substantially lower cost(45.69,
$196.61vs 43.97,$940.03), demonstrating its scalability and cost-effectiveness. Moreover, under the same data budget, adding synthetic data improves AndroidWorld success to 44.83%, and Real+Aug+Gen reaches 48.28%, highlighting the complementary value of synthetic data. -
The AC-Curated Regression stems from fine-tuning Our experiments show that SFT and synthetic data contribute comparably to the Box Acc drop. The regression therefore stems partly from fine-tuning and partly from synthetic data . Further analysis of coordinate errors indicates that the loss is systematic: most errors lie far outside the annotation and concentrate on compact targets, which explains why the offline metric drops while online task success improves at all three scales.
-
Our core innovation is a unified state representation Our core innovation is a unified state representation that simultaneously accounts for visual realism and operational feasibility, something existing GUI world models cannot achieve. we represent GUI transitions as structured, coordinate-free deltas encoding trigger operations, added/removed elements, and subsequent affordances. This representation enables both learning from real interaction pairs and generation from text-only plans, bridging the gap between visually faithful simulation and executable GUI interactions. None of prior GUI world model has achieved such goal before.
We hope this response has addressed your questions. Please feel free to raise any further issues at any time; we are happy to continue the discussion.
Thank you for recognizing our contribution. We hope the following reply can address your concern.
We conduct matched-budget comparisons at two levels. We first extend the data-volume ablation to 27,360 samples, with a 9:1 real-to-synthetic ratio and matched optimization budget and task coverage. Under this control, adding synthetic data improves AndroidWorld success to 44.83%, and Real+Aug+Gen reaches 48.28%:
We further compare real and synthetic data with Qwen3.5-4B under matched budgets. Synthetic data scales better, surpassing real data at a larger scale with lower cost:
we have revised our manuscript accordingly. (see PDF page 8, Section 4.4 and Table 3; PDF page 46, Appendix I.1; PDF page 48, Appendix I.3)
Our cost analysis shows that our pipeline is more cost-efficient, achieving higher downstream performance than real-data collection at a much lower total cost when scaled up. It costs only
$0.032per step, 9.6×, 11.9×, and 10.8× cheaper than OpenMobile, AndroidControl, and AITZ, respectively. 6k synthetic samples reach 45.69% AndroidWorld success at$196.61, versus 3k real samples at 43.97% and$940.03.We also provide cost breakdowns against OpenMobile and Code2World, plus the costs of public datasets. The one-time world-model fine-tuning cost is $432 and does not scale with data volume, so our pipeline becomes more cost-effective as the dataset grows.
We further fine-tune Qwen3.5-4B under different generation and collection budgets. Although real data is better at the same volume, ours performs better at a larger scale with substantially lower total cost:
we have revised our manuscript accordingly. (see PDF pages 47-48, Appendix I.2; PDF page 48, Appendix I.3)
[1] Rui Lv, et al. "M$^2$-Miner: Multi-Agent Enhanced MCTS for Mobile GUI Agent Data Mining" ICLR 2026
We add a real-4B control under the same protocol, comparing base-4B, real-4B, and Infinite-Actor-4B on AC-Curated-Hard. SFT and synthetic data contribute comparably to the Box Acc drop, while synthetic data contributes more to the Step SR drop; the regression thus stems partly from synthetic data and partly from fine-tuning:
We further analyze the coordinate errors: the Hard median center distance grows from 0.18 to 0.38 annotated-box widths, 97% of incorrect boxes place their center more than 50 px outside the annotation, and Box Acc is 46.7% on the smallest third of targets versus 75.4% on the largest third. The loss is systematic: most errors are far outside the annotation and concentrate on compact targets, explaining why the offline metric drops while online task success improves at all three scales:
we have revised our manuscript accordingly. (see PDF page 8, Section 4.3; PDF page 44, Appendix G.3; PDF pages 48-49, Appendix I.5)