- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ECHOES, a long-horizon GUI agent framework that combines recursive textual memory, privileged on-policy distillation, and RL. It also introduces ECHOESBMK to evaluate perception and memory fidelity. Experiments show improvements across several GUI benchmarks.
Critical strengths
1.The problem is practical and important. Reducing historical image overhead while preserving useful task information is a meaningful direction.
2.The experiments cover multiple benchmarks, and the efficiency and ablation results are encouraging.
Critical weaknesses
-
The framework mainly combines existing techniques, including history summarization, on-policy distillation, and RL. I'm not fully convinced by the novelty of the PMF-guided scheduling. Its improvement over standard linear scheduling is only 3.46 points, and stronger scheduling baselines are missing.
-
The proposed PMF benchmark mainly evaluates single-screen summaries rather than recursive memory across long trajectories. Also, most GUI results rely on offline action evaluation rather than actual end-to-end task completion. These results do not support the claimed long-horizon reliability.
Minor Comments
1.The privileged teacher only observes up to four previous screenshots, which may limit supervision of longer-term dependencies.
2.The zero-shot transfer experiment contains only 20 Sokoban tasks, making the generalization claim somewhat limited.
3.The main comparison uses different inference-history protocols across baselines.
Questions for authors
1.How does PMF-guided scheduling compare against fixed-weight or other adaptive weighting strategies?
2.Can the authors evaluate memory fidelity over longer recursive trajectories?
3.Are there end-to-end online GUI task completion results?