- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper decouples long-horizon manipulation in WAM into coarse long horizon prediction and fine-grained local dynamic prediction, using two streams that differ in their conditioning. The local stream, conditioned on the current observation, predicts dense-near future; the long horizon stream, conditioned on the chunk of the history observation, predicts sparse, downsampled futures over a brader horizon. Together, they yield actions that are both locally precise and aware of long-range dependencies.
Critical strengths
The paper is exceptionally well written. The method is presented concisely and without unnecessary detail, and the exposition is clear and reader friendly. The conclusions are easy to follow. In addition, the authors have made a substantial effort in implementing and evaluating a broad set of baselines, resulting in a thorough and convincing comparison.
Critical weaknesses
- Problem framing: Narrowing the problem to the long-horizon ability of WAMs seems unnecessary. A WAM is only a tool; long-horizon manipulation itself is the more important problem.
- Missing baselines: The paper does not compare against methods that are known to handle long-horizon tasks well, such as open-world TAMP systems and agent-based approaches. Without these comparisons, it is unclear why a WAM is necessary for these tasks.
- Insufficient evaluation of the long-horizon claim: General benchmarks such as RoboDojo are not sufficient to support the paper's long-horizon claim, and it remains unclear whether the gains come from the proposed design or simply from additional parameters.
Questions for authors
- Is handling long-horizon dependencies implicitly a better design than handling them explicitly (e.g., with TAMP)?
- Where is long-horizon reasoning required in the test cases? A case study on subtask dependencies (e.g., opening a drawer occluding later manipulation) would help.
- Do the gains come from the design rather than more parameters?
- How do the predictions and actions behave under multiple possible outcomes, such as a ball bouncing in different directions?
I thank the authors for the additional experiments and for reporting the results candidly. They address most of my earlier concerns.
The two-stream policy is simple. Compared with the baselines, it improves on some dimensions and shows no gain on others. I see these mixed results as a strength, not a weakness: negative results are valuable when they are presented clearly. To get the most out of them, I encourage the authors to analyze when the two-stream design helps and when it does not, and to discuss possible reasons for each case. That analysis would turn the empirical findings into a real insight for the community.
I also encourage the authors to use the new terminology more carefully, especially “state evolution” and “local dynamics.” As currently presented, the evidence does not clearly support these interpretations.
I am willing to raise my score to 3 (weak accept) if the authors do either of the following: