- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies RL post-training for memory management in long-horizon GUI agents. Building on MemGUI-Agent's ConAct interface and MemGUI-8B-SFT, the authors propose FARPO, which combines GDPO-style per-component reward normalization with resampling of span- and step-folding examples to mitigate differences in reward scale and insufficient training signal for span folding. Training uses fixed annotated states from MemGUI-3K: the current policy samples candidate responses, and a rule-based verifier assigns rewards based on agreement with the annotations, without device interaction during training. The resulting model achieves 48.4% Pass@3 and 39.0% information retention on MemGUI-Bench, and a 19.7% success rate on MobileWorld GUI-only.
Critical strengths
- The experimental analysis is reasonably thorough. Stepwise ablations, experiments with seven data mixtures, and measurements of zero-advantage groups help characterize how reward normalization and sample composition affect the policy. In particular, the results reveal substantial changes in folding behavior across training mixtures and a non-monotonic relationship between folding frequency and task performance, providing useful empirical observations for further research.
- The paper is easy to follow, with well-presented figures and tables. The anonymous project page is particularly helpful: it clearly summarizes the central ideas and results and makes the paper easier to assess.
Critical weaknesses
- The problem formulation is narrow, and the paper does not establish that the identified challenges are shared bottlenecks in the field. The two challenges depend on the authors' four-component reward design and the span/step annotation distribution in MemGUI-3K, respectively. Although reward-scale differences and insufficient training signal may arise more broadly, the experiments cover only the ConAct interface, a single dataset, and one verifier. The contribution therefore appears primarily to refine the post-training procedure of MemGUI-Agent.
- The methodological novelty is limited. Reward decoupling directly adopts GDPO's per-component normalization, while folding-aware sampling uses conventional majority-class downsampling. The paper does not sufficiently establish a distinct methodological contribution from combining these components. Moreover, the ablations omit a "scalar GRPO + folding-aware sampling" control, leaving unclear whether resampling alone accounts for most of the gains and whether the two components meaningfully interact.
- The rationale for the high span-folding rate remains insufficiently validated. The original ConAct design treats single-step distillation and multi-step consolidation after subtask completion as complementary operations; a low span-folding rate therefore does not necessarily imply inadequate compression. FARPO increases the deployment-time span-folding rate to 91.7%, but the paper does not adequately examine whether these folds occur at appropriate subtask boundaries or reflect a tendency to perform multi-step compression at nearly every step. Higher task scores alone do not establish that the model has learned to select folding timing and granularity according to the current state.
- The paper does not evaluate FARPO with larger models or increasing amounts of training data, leaving its generality and scalability untested. Pass@3 on the hardest task group decreases from 34.2% for the SFT model to 28.9%, while the improvement on MobileWorld amounts to only two additional completed tasks. These results provide limited evidence of a substantial improvement on out-of-distribution tasks.
Questions for authors
- The PDF is titled "FARPO: Folding-Aware Reward-Decoupled Policy Optimization for Long-Horizon Mobile GUI Agents", whereas the submission title is "MemGUI-RL: Reinforcement Learning for Proactive Context Management in Long-Horizon Mobile GUI Agents." This may simply reflect an unsynchronized title revision, and I would not regard the discrepancy alone as a policy violation. Could the authors clarify the reason for the difference?
- Why should the original span-folding rate be regarded as a training bottleneck rather than a reasonable outcome of the teacher's state-dependent decisions? The latter possibility seems central to understanding the underlying problem.
- Of the span folds that account for 91.7% of folding operations at deployment, what proportion occurs at clear subtask boundaries, and what proportion repeatedly compresses existing summaries?