- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
GenPA fine-tunes a pretrained image-generation backbone for robot control using a lightweight action regression adapter. Its auxiliary visual objective predicts current-scene perceptual targets, such as depth, rather than future observations. Deployment requires one backbone forward pass without image generation or iterative action denoising. Experiments on LIBERO, LIBERO-Plus, RoboTwin 2.0, and a real-world USB manipulation task demonstrate competitive performance and low inference latency. Ablations examine action decoding and alternative visual supervision targets.
Critical strengths
- GenPA achieves competitive control performance with a lightweight regression adapter and 20.9 ms compiled inference on H100. The internal regression–flow comparison supports the practical value of simplifying action generation.
- Within a common policy architecture, current-depth supervision improves LIBERO-Plus robustness over action-only training and performs competitively with future-RGB supervision.
Critical weaknesses
Fast-WAM already removes future generation at inference, and ImageWAM already adapts image-editing backbones for control. GenPA’s additional contribution centers on current-perception co-training and lightweight action regression. Its significance therefore rests primarily on the empirical effectiveness of this combination.
Questions for authors
- Can you provide repeated-seed results for the regression–flow and None/depth/future-RGB comparisons, with evaluation separated from checkpoint selection?
- Did the real-world baselines receive the same image augmentations as GenPA?
4 comments
Follow-up on our response
Thank you again for your constructive feedback. We would like to briefly follow up on our November 11 response, particularly the additions addressing your two questions:
- Three-seed training for the regression–flow and action-only/depth/future-RGB comparisons, with complete checkpoint scans and both selected and fixed-final results.
- Independent evaluation of the selected seed-42 policies on three new initial-state sets disjoint from checkpoint selection.
- Explicit clarification that the real-world baselines used different augmentation recipes, with these differences documented and the comparison’s interpretation qualified.
We would appreciate your feedback on whether these additions address your concerns, and are happy to clarify any remaining questions.
Thanks for the detailed response. I maintain my rating.
Thank you for your feedback
Thank you for reviewing our responses and additional experiments. We appreciate your constructive feedback and continued support.
Response to Reviewer ykMf
We thank the reviewer for the careful assessment and constructive suggestions. Section and table references below refer to the revised manuscript.
W1. Relation to Fast-WAM and ImageWAM
We agree that Fast-WAM and ImageWAM already enable inference without generating future images; their main formulations retain future-prediction co-training. Our contribution concerns how the generator is trained for control: GenPA combines direct action learning with native current-scene perception co-training. Within this framework, we compare current targets, future targets, and their combinations under a common policy architecture.
These comparisons show that current-scene supervision can improve control robustness without future prediction, while combining individually useful targets does not consistently improve performance (Section 3.6). Repeated training and fixed-final-checkpoint comparisons support the robustness gains, complemented by independent standard-LIBERO evaluations. The action-head ranking also varies across evaluation settings (Q1). This establishes current perception as an effective training alternative, with evidence on its benefits and limits.
We also characterize efficiency beyond the action head: component-level measurements show how recurring observation-processing costs and instruction-encoding reuse affect latency alongside action decoding (Section 3.4). This identifies the computational factors underlying efficient control with image-generation backbones.
Q1. Repeated training and independent evaluation
We now report results from three training seeds for each of the four configurations, complete ten-checkpoint LIBERO scans, results for both selected and fixed-final checkpoints, and separate fixed-policy evaluation on three new initial-state sets disjoint from selection.
Depth and future-RGB supervision improve mean Plus success over action-only training in all four Plus settings. With current-depth supervision, regression has higher standard LIBERO success, but flow leads on Plus under Official instructions and at the endpoint under Clean instructions.
Repeated training. All configurations use action regression except “Depth + flow.” Success rates (%) are mean ± sample SD across the three training runs.
Selected is the checkpoint with the highest standard LIBERO success; Final is the fixed training endpoint. Plus never enters selection. Clean denotes the original paper’s main Plus setting, which removes appended perturbation metadata from instructions for non-language perturbations; Official uses released instructions (Appendices C.1–C.2).
The LIBERO rows reuse selection states; independent evaluation is reported below.
Independent-state evaluation. We fixed the selected checkpoints from training seed 42 and tested them on three shared sets of new states disjoint from selection, totaling 6,000 episodes per policy. Mean ± sample SD across evaluation sets is 97.63 ± 0.24% (action-only), 98.33 ± 0.29% (current depth), 97.80 ± 0.05% (future RGB), and 97.03 ± 0.33% (depth + flow). These results measure evaluation variability for fixed policies; we did not test all three training runs on the new states.
Complete per-seed ten-checkpoint scans are in Appendix C.3, Tables 24–25. The selected/final results across training seeds are in Appendix B.5/Table 17 and Appendix D.1/Table 28; independent-state results are in Appendix C.3, Table 26.
Q2. Image augmentation in real-world baselines
No. Each method used its own image-augmentation recipe; Fast-WAM used deterministic preprocessing without random augmentation. Appendix E.1 now details these differences. The real-world comparison therefore reflects both policy design and augmentation, without isolating their individual effects.