- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Ψ0.1 is a humanoid control framework that explicitly guides a VLA policy with generated future images. A subtask predictor manages task progression, while a time-conditioned image model generates near-term visual goals. The planner conditions on the current observation and goal image to produce whole-body actions executed through SONIC with real-time action chunking. Its VLM is pretrained to predict variable-length action sequences connecting current and future frames, then frozen while a continuous action expert learns fixed-length action chunks. Real-G1 experiments compare the system with VLA and world-action-model baselines on pick-and-place tasks involving novel objects, containers, and layouts, and on a household routine lasting approximately five minutes. The paper also evaluates one-demonstration adaptation to a changed task order and provides real-robot ablations of goal-image conditioning, variable-length pretraining, and humanoid post-training.
Critical strengths
- A coherent design for explicit visual-goal guidance. The paper connects subtask prediction, time-conditioned future-image generation, and goal-conditioned action generation in a clear architecture. Generated goals give the policy a concrete visual target, while asynchronous execution allows the planner to keep acting as goals are refreshed. This is a practical approach to improving instruction following in unfamiliar scenes.
- An effective variable-length action pretraining objective. Predicting the actions connecting current and future frames is a well-motivated way to teach the VLM to use goal images. Table 1 provides direct downstream evidence: variable-length pretraining improves real-robot success from 4/10 to 7/10 on both tabletop and whole-body pick-and-place compared with fixed-length pretraining. This is a useful training contribution supported by more than offline prediction metrics.
- Convincing real-robot evaluation of generalization and whole-body execution. The experiments test novel objects, containers, and destination layouts, with comparisons against both VLA and world-action-model baselines. The whole-body tasks require coordinated behaviors such as walking, operating a bin pedal, and kneeling to place an object. These evaluations meaningfully test whether the policy follows the intended goal beyond familiar training configurations.
- A substantial demonstration of task composition. The system chains separately demonstrated household tasks into a routine lasting approximately five minutes and evaluates transitions between tasks. The additional one-demonstration adaptation experiment tests a changed task order rather than only replaying the original sequence. Together, these results show the practical relevance of the proposed guidance mechanism for extended humanoid operation.
Critical weaknesses
- Temporal conditioning — Suggested additional experiment. The predictor ablation shows that caption-plus-frame-rate conditioning improves image metrics over caption-only conditioning, but does not establish whether this improves closed-loop control. Please compare these predictor variants using the same downstream planner and task settings, and report whether the image-quality gains translate into better task performance.
- Explicit versus implicit guidance — Suggested discussion. Comparisons with Cosmos3 and DiT4DiT establish a system-level advantage, but architectural and pretraining differences prevent attributing the gains solely to explicit goal conditioning. Please discuss these confounding factors and distinguish the demonstrated performance gains from the proposed explanation that explicit guidance is more effective than implicit guidance. I view this primarily as a matter of interpretation rather than a request for an additional baseline.
- Evaluation reliability — Suggested additional results and clarification. The small trial counts leave uncertainty around the reported success rates. Please provide uncertainty estimates and, where feasible, additional trials. For the long-horizon routine, report fully autonomous completions out of all attempts and clarify the intervention protocol, distinguishing uninterrupted execution from task progress evaluated with assistance after failures.
Questions for authors
- Operating boundaries of explicit visual guidance — Additional analysis and discussion. This is the most important question for my assessment. Beyond the successful demonstrations, when does an explicit visual goal help the policy, when can it mislead the policy, and why? Appendix G provides useful subtask-prediction statistics, and the conclusion acknowledges limitations in goal-image quality, but I would appreciate a richer end-to-end analysis with representative successes and failures. In particular, how does the planner respond to inaccurate, ambiguous, or infeasible goals, and do subsequent goal updates correct or propagate errors? Where possible, please distinguish failures of subtask selection, image prediction, action planning, and execution. This would help establish how robust the central contribution is and under what conditions its benefits hold. A convincing analysis addressing these boundaries would materially strengthen my assessment and could lead me to raise my rating.
- Temporal conditioning — Additional experimental evidence. Does the improvement from caption-plus-frame-rate conditioning over caption-only conditioning translate into better closed-loop task performance when both predictors are paired with the same planner? A matched comparison would help establish the control benefit of temporal conditioning beyond improved image metrics.
- Generated versus ground-truth goals — Clarification and ablation. What motivated the 50/50 mixture of generated and ground-truth future images during training? Have you compared it with training exclusively on ground-truth future images while using generated goals at deployment for both variants? Please also provide the evidence supporting the statement that using only ground-truth future frames during final task fine-tuning causes no performance drop.
Response to Reviewer yHLy: operating boundaries of explicit visual guidance and failure analysis
We thank the reviewer for the constructive review.
Q1: Operating boundaries of explicit visual guidance. In short, explicit visual guidance works because the planner does what the future image shows. We screened the logs of all 618 real-robot rollouts and added a failure analysis with representative cases (new App. I), attributing each failure to the component that failed first (Table 5):
The planner follows the motion, grasp pose and object shown in the future image. A correct future image therefore steers the robot through situations that the instruction does not describe, such as a novel layout that requires turning farther than in training (Fig. 8). For the same reason, an error in the future image becomes an error in the action: a blurred hand leads to a grasp from above instead of upright (Fig. 9a,b), and a wrong subtask leads to an infeasible future image that the robot still follows (Fig. 10). As future images are regenerated every 0.8 s, a small deviation of the robot is corrected by the next future image, whereas a large one propagates, because the world model is then conditioned on the deviated view (Fig. 11). The benefits thus hold when the future image is clear and correct, the subtask is correct, and the robot stays close to the predicted state (App. I, "Operating boundary"). A more accurate world model that is less affected by such deviations would directly remove the largest group of guidance-related failures, which is our main direction for future work.
W1/Q2: Temporal conditioning in closed loop. With the same planner on the 12 novel tabletop settings, the predictor with caption and frame rate reaches 9/12 and the caption-only predictor 8/12. The image-quality gain (App. G, Table 3) carries over in direction, but the effect is small and shows up in fine details such as the hand pose (App. I, Fig. 9a; see also our response to Reviewer f7S3, Weakness 2).
W2: Explicit versus implicit guidance. We agree that the system-level comparison alone cannot establish this; Table 1 gives more direct evidence. In variant (c), we take the Ψ0 VLM, which is pre-trained on single images only, and add the future image only during task fine-tuning, without any pre-training for explicit guidance. This alone raises success from 18% to 50% (a→c) and already matches the two WAMs (Fig. 3), although they are pre-trained at scale on video for their implicit guidance. Once the VLM is also pre-trained for explicit guidance, with variable-length action chunks that connect the current and future images, Ψ0.1 performs far above both. We read this as evidence that explicit visual guidance is an effective way to steer the policy, while acknowledging the remaining architectural differences.
W3: Evaluation reliability. This overlaps with Weakness 3 of Reviewer f7S3, and our response there gives the full numbers. In short, we doubled the ablation to 20 trials per variant and task (Table 1, Sec. 4.4), and large gaps, such as adding the future image, have clearly separated 95% intervals. In the long-horizon routine (10 runs per method), Ψ0.1 completes the entire routine without any assistance in 3 of 10 runs, and no baseline does. Task Progress is measured under a fixed intervention protocol in which the evaluator only restores the state at which a failed stage would have ended and assisted stages receive no credit (Sec. 4.3; new App. J, Table 6).
Q3: Generated versus ground-truth goals. The mixture (Sec. 3.3) exposes the VLM to the artifacts of generated images, which it sees at deployment, while keeping clean supervision; generated images alone would pair the demonstrated actions with lower-quality future images, which makes the supervision less precise. Comparing them in pre- and post-training would require repeating both stages (pre-training alone takes 20 days on 32 H100 GPUs, Sec. 4.1), which we leave to future work. For task fine-tuning, we ran the comparison (App. H, Fig. 7b; see our response to Reviewer f7S3, Weakness 4): with generated future images at deployment, fine-tuning on ground truth alone matches the 50/50 mixture on both tasks, since the planner has already seen generated images in the earlier stages, while generated images alone lower whole-body success.
We hope these additions address the reviewer's concerns and are happy to discuss further.