- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes ReCAP, a training-free context scheduling method for long-horizon autoregressive robot video world models. ReCAP preserves an initial scene anchor and a fixed window of recent visual–action blocks while evicting older generated history. The method is evaluated across four robotics datasets and three world-model backbones, reporting improvements in visual fidelity, trajectory consistency, semantic evaluation, and inference efficiency.
Critical strengths
-
The method requires no additional training, and it bounds inference context and memory consumption independently of rollout length.
-
The experiments show improvements across multiple datasets, model backbones, and evaluation metrics, including substantial gains in visual prediction quality and concurrent inference throughput.
Critical weaknesses
-
Apart from scheduling complete visual–action blocks rather than individual tokens, the core method closely resembles the attention-sink-plus-recent-window strategy of StreamingLLM. More importantly, Figure 6(a) shows that ReCAP and Recent Only achieve statistically indistinguishable LPIPS-AUC results. Although Appendix E reports small benefits from longer scene prefixes, the necessity of anchor preservation remains insufficiently established.
-
While the paper points to potential applications in planning and policy evaluation, its experiments are limited to offline action-conditioned video prediction. The foreground-based trajectory metrics are indirect proxies for robot motion. The VLM judgments, whose prompt explicitly penalizes static arms and discourages tied scores, and the limited internal human evaluation cannot establish physical consistency or task success.
Questions for authors
-
Given the negligible difference between ReCAP and Recent Only in Figure 6(a), what evidence supports the importance of anchor preservation? Can the authors report the Recent Only comparison across all backbones, datasets, horizons, and metrics in Table 1, rather than only LPIPS-AUC for RLVR-World?
-
The 1931-token context exactly matches the adaptation training sequence length of the adapted models, whereas Full Context grows far beyond it. The improvements may therefore primarily reflect avoiding out-of-distribution context lengths rather than resolving the proposed memory-role conflict. How can the authors distinguish the proposed memory-role conflict from training-context-length mismatch and positional effects? Could length-matched or position-controlled comparisons clarify the underlying mechanism?
-
Can the authors explain the unusually uniform improvements across different datasets in Table 1 (for iVideoGPT and RoboAlign-R1, particularly in LPIPS, nDTW, and VLM scores), and the per-episode LPIPS and SSIM 100% win rates in Table 2? Could the authors provide more evaluation details, such as the evaluation sample sizes, exact horizons, and per-episode results.