- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Let'sPlay, a gameplay trajectory dataset covering 25 games, 2,036 trajectories, and 315K action steps. Each step contains visual observations, device actions, and language annotations. The authors also develop PlayAgent by fine tuning a VLM with history windows, curriculum learning, and action weighted loss. Experiments show that PlayAgent achieves a 36.0% task success rate across 125 tasks.
Critical strengths
- Let'sPlay provides gameplay trajectories with visual observations, device actions, and language annotations across 25 games. This could be a useful resource for training visual game agents.
- PlayAgent substantially improves over its base model, showing the value of gameplay trajectory supervision.
Critical weaknesses
- Limited novelty. The proposed method mainly combines standard sft, curriculum learning, and weighted loss. The technical contribution is relatively simple, with limited methodological novelty.
- Insufficient experimental analysis.The paper lacks ablation studies for its key components, making it difficult to identify what drives the performance gains. The improvement over the strongest baseline is also modest, and generalization to unseen games is not evaluated.
- The paper lacks visualizations of the dataset, model architecture, and gameplay examples.
Questions for authors
Can the authors provide ablation studies to clarify the individual contributions of language annotations, curriculum learning, action loss weighting, and history windows? How well does PlayAgent generalize to unseen games that are not included in the training dataset?