W1. Substantial architectural complexity and limited methodological novelty of the individual components
My primary concern is whether the complexity of the proposed framework is sufficiently justified by its methodological contributions.
CL-WAM combines several established ideas, including recurrent belief-state estimation, Kalman-inspired observation correction, external memory, port-Hamiltonian-inspired dynamics, scheduled rollout training, and hierarchical candidate-based planning.
Although their integration into a world-action model is meaningful, many of these components have close precedents in model-based reinforcement learning, state-space modeling, structured dynamics learning, and closed-loop imitation learning.
The paper introduces approximately 58 million additional trainable parameters and multiple auxiliary objectives, resulting in a relatively complicated training and inference pipeline.
The controlled experiments are appreciated and help justify the complete system. However, the results also indicate that a substantial part of the improvement comes from the closed-loop rollout schedule alone. In Appendix N, introducing this schedule increases RoboCasa-GR1 success from 55.08% to 62.33%, while adding the remaining belief, memory, and port-Hamiltonian components further increases performance to 67.50%.
These findings demonstrate that the additional components are useful collectively, but they also raise questions about whether a simpler closed-loop architecture could capture most of the benefits.
A more explicit investigation of the interactions among these components, particularly whether each component provides complementary improvements beyond the rollout-training mechanism, would help clarify the principal methodological contribution and the necessity of the full design.
W2. Insufficient validation of the physical interpretation and action-conditioned predictive capability of the port-Hamiltonian latent dynamics
The proposed port-Hamiltonian-inspired latent dynamics model is an interesting component, but its relationship to physically meaningful action-conditioned state transitions remains insufficiently established.
As described in the implementation details, the port-Hamiltonian flow is trained using a flow-matching objective between the corrected latent belief and independently sampled Gaussian noise, rather than directly supervising action-conditioned transitions between observed physical states.
Consequently, the objective does not by itself establish whether the resulting latent dynamics accurately represent the consequences of different robot actions.
This distinction is important because the slow planning pathway propagates candidate action sequences through the learned latent field and uses the resulting states for candidate scoring.
Furthermore, the conditional energy-balance result only establishes a dissipation property for the isolated autonomous component under fixed conditioning. It does not guarantee passivity or stability of the complete learned dynamics or the executed robot.
The positive-autonomous-power penalty is also identically zero in exact arithmetic under the proposed skew-symmetric and positive-semidefinite parameterization. Therefore, the reported ablation that disables the port-Hamiltonian structural penalties should not be interpreted as directly isolating the benefit of these structural constraints.
The authors do provide an additional capacity-matched unconstrained-MLP comparison, which is valuable. Nevertheless, more direct evaluations of action-conditioned prediction accuracy, counterfactual state transitions, and the relationship between candidate scores and realized outcomes would substantially strengthen the claims associated with the structured latent dynamics.
Overall, I believe the paper provides evidence that the port-Hamiltonian-inspired representation is useful for control, but the extent to which it constitutes a reliable physical dynamics model remains unclear.
W3. Limited statistical evidence for improvements in real-world humanoid manipulation
Although the paper includes seven real-world Unitree G1 manipulation tasks, the observed improvements over the matched DiT4DiT baseline are relatively modest.
CL-WAM achieves 109 successful trials out of 140, compared with 101 out of 140 for DiT4DiT, corresponding to a 5.7-percentage-point improvement.
At the individual task level, most improvements correspond to only one or two additional successful trials. Similarly, the reported real-world distribution-shift evaluations include only 20 trials per condition, limiting the strength of conclusions regarding generalization and robustness.
These results are encouraging, but they do not provide strong statistical evidence that the observed improvements will consistently generalize across different physical environments, robot instances, or interaction conditions.
Furthermore, the real-world evaluations primarily focus on tabletop manipulation using the humanoid's arms and grippers. The proposed closed-loop formulation is motivated partly by contact dynamics and recovery from prediction errors, but the experiments provide limited direct evaluation of recovery from unexpected physical disturbances, failed grasps, or significant deviations between planned and executed actions.
While the simulation experiments provide substantially stronger quantitative evidence, additional physical evaluations focused on these failure modes would help establish the practical significance of the proposed feedback mechanisms.
Clarifying CL-WAM’s novelty and component evidence
We thank the reviewer for recognizing the empirical gains and controlled comparisons. The revised manuscript adds a Mechanism Tests subsection and summary table to the main text. Appendices H, I, and N give the full protocols and results.
Q1. What is methodologically new? CL-WAM uses the discrepancy between the incoming observation embedding and its prediction from the belief prior to correct a persistent state shared by world prediction and action generation. At each policy call, the previous corrected belief, memory, and last executed action produce a belief prior, from which the model predicts the observation embedding. The observation innovation corrects the belief before memory is updated and the next action is generated. The corrected belief also initializes port-Hamiltonian (pH) candidate rollouts when slow planning is due. On the scheduled-mixing training path, real and self-generated visual features enter this same prediction–correction update, linking training exposure to the deployed feedback rule.
World-VLA-Loop uses policy rollouts to refine the world model and policy across training rounds. MemoryVLA updates memory that conditions an action expert. CL-WAM closes the feedback loop within each deployed policy call by using the incoming observation to correct the predictive belief used for subsequent prediction, planning, and control.
Q2. What contributes beyond the rollout schedule? In Appendix N, DiT4DiT +58M obtains 55.08%, adding only the schedule reaches 62.33%, and submitted Full CL-WAM reaches 67.50% on RoboCasa-GR1. The last 5.17-point gap compares whole systems. We therefore ran a separate five-seed, pH-free study with 527M trainable parameters per variant, the same rollout schedule, training budget, eight-candidate planner and non-pH transition, a shared frozen contact predictor, and matched evaluation resets. Across 6,000 trials per variant, success is 61.83% without persistent belief, 63.93% with GRU belief, and 66.40% with innovation-corrected belief. Innovation correction exceeds GRU by 2.47 points (five-seed paired-t 95% CI [2.31, 2.62], conditional on the fixed tasks and resets). In the matched evaluation, 458 trials succeed only with innovation correction versus 310 only with GRU. At horizon 8, future-observation MSE falls from 0.0106 to 0.0082 on 1,138 valid paired event windows (22.6% reduction). In a separate three-seed matched candidate-scoring study (Appendix N.1), memory raises success from 64.17% to 65.00% when added to innovation belief plus a non-pH transition. Replacing that transition with pH, with memory disabled, reaches 65.83% (+1.67 points over the same belief baseline). The task-cost heads share architecture and supervision but are trained separately. The contact predictor shares frozen weights. We interpret only within-study differences as component effects.
Q3. What does the pH parameterization provide over an unconstrained MLP? The complete-field MLP replacement reported in Appendix A reaches 65.3%, versus 67.50% for Full CL-WAM. Table 3’s intervention disables the two pH auxiliary regularizers while retaining the structured field. To examine the field directly, we added same-state action-intervention results in Appendix I and summarized them in Table 4 in Sec. 4.5. Across 360 held-out simulator snapshots, each variant evaluates the same eight candidate actions from the same restored initial state. At planning position 24, Full pH obtains action-effect MSE 0.00190, effect cosine 0.71, and candidate-rank correlation 0.64. The retrained capacity-matched unconstrained MLP obtains 0.00243, 0.59, and 0.53. The pH field reduces measured action-effect MSE by 21.8% (paired MLP-minus-pH difference 0.00053, 95% CI [0.00035, 0.00072]), while candidate-rank correlation improves by 0.11 (95% CI [0.06, 0.16]). Ranking uses independently measured simulator task progress. The Spearman average covers the 324 snapshots with nonconstant candidate progress. Shuffling candidate actions increases effect MSE to 0.00410, and zeroing the control field gives the zero-effect reference of 0.00465. Candidate actions are executed directly in this diagnostic. At deployment, the selected candidate is converted into a plan token that conditions executable actions sampled from fresh noise.
These direct controls show where CL-WAM closes the loop, distinguish innovation correction from generic recurrence, and identify the structured field’s contribution to action-dependent latent effects and candidate selection.