acceptodds
Under review as a conference paper at ICLR 2027

Reuse, Rewrite, or Reject: Guarded Replay for Mobile GUI Agents

Abstract

Mobile GUI agents frequently perform repetitive tasks with similar interaction procedures. Reusing previous executions can reduce redundant LLM inference and execution overhead, but variations in user instructions and execution environments may invalidate previously successful actions. We systematically characterize these variations into six representative categories and observe that such changes do not necessarily invalidate entire procedures: individual transitions can remain reusable when validated against the current task context and interface state. Based on this insight, we propose graph–text templates for selective execution-trace reuse. The graph captures UI states and action transitions, while the text encodes task intent, procedural structure, and typed slots for variable content. A record–template–replay framework constructs templates from verified executions and leverages the current instruction and live UI state to reuse, adapt, or discard individual transitions. Given an execution trace, our framework reduces LLM inference token consumption by approximately 80% on average across five base agents on AndroidWorld, with most agents achieving at least 1.5 execution speedup over LLM-only execution. Real-device evaluations on Android and HarmonyOS demonstrate over 2 execution speedup in most evaluated configurations.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.