- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PatchWAM represents each action step as a patch-width token through a fixed replication-and-padding codec and jointly denoises action and future-image tokens within an image diffusion transformer. It removes a dedicated action expert and evaluates the resulting interface across data scales, image backbones, and manipulation benchmarks. Probes and future-clamping interventions investigate the relationship between predicted images and actions.
Critical strengths
-
The one-token-per-step interface is simple, executable without a learned decoder, and potentially useful for adapting image backbones. Gains of 5.8-14.3 percentage points over the matched dual-expert configuration across five training-window scales, plus a second-backbone result, constitute meaningful evidence for the complete architecture.
-
The paper includes informative negative results and qualifications. The learned-linear codec performs almost identically to the fixed codec, and the authors explicitly acknowledge that most success does not depend on direct future-action attention in the tested regime. The probe and clamping experiments provide evidence that generated futures contain additional action-related information and that modifying them can alter generated actions
Critical weaknesses
-
The conceptual novelty is narrower than the high-level no-action-expert framing suggests. The already-cited Cosmos Policy [1] directly injects normalized, duplicated action values into latent frames without architectural modifications, while Action Images [2] provides another, different route to head-free policy generation. PatchWAM's particular contribution is the per-step single-patch interface within an image backbone, not parameter-free action injection in general. Table 3 supports the sufficiency of the fixed codec, but 94.57% versus 94.50% does not establish a performance advantage of parameter-free encoding. The large dual-expert gains jointly change action processing, attention visibility, and parameter allocation, leaving the source and distinctive benefit of the new interface unresolved.
-
The future-readout motivation is only partially validated. A future image can constrain motion without uniquely identifying the intervening trajectory, contacts, or gripper timing. The probe explains 29.8% of within-chunk motion variance with the predicted future, versus 12.2% from the current image and 30.1% with the true future: matching the true-future probe is not equivalent to recovering most of the motion. Removing direct future-action attention reduces success by only 0.58 points in a single training run. Clamping establishes sensitivity, not that this pathway explains the main accuracy gain. The authors acknowledge this limitation; my concern is that the remaining engineering contribution is not sufficiently disentangled from a more generic shared-backbone policy benefit.
[1] Kim, Moo Jin, et al. "Cosmos policy: Fine-tuning video models for visuomotor control and planning." arXiv preprint arXiv:2601.16163 (2026). [2] Zhen, Haoyu, et al. "Action Images: End-to-End Policy Learning via Multiview Video Generation." arXiv preprint arXiv:2604.06168 (2026).
Questions for authors
- Under the same backbone, data, optimization, and comparable action-processing capacity, what gain remains from the proposed patch interface when attention visibility is matched? A focused factorization is needed, rather than another comparison between complete heterogeneous systems.
- Can the future-readout analysis distinguish additional predictive information from a mechanism responsible for improved control, using policy-unseen episodes or repeated-training evidence for the attention ablation? Otherwise, will the authors limit the claim to a useful joint interface with observable but non-dominant future dependence?
- Please clarify common evaluation denominators after skipped or replaced simulator runs, and report latency at the actual 10-step evaluation setting if available. These details determine how confidently the practical advantage can be compared.