- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose FlexiWorld, a JEPA-based world model that combines mixed-span goal supervision with variable-length action chunks. FlexiWorld jointly learns latent prediction and goal-conditioned action generation for action chunks of different lengths using a variable-length causal action encoder and an autoregressive actor. During planning, FlexiWorld can either perform Direct planning or refine actor-generated plans through action-residual search using ARCEM.
Critical strengths
- The authors examine specific limitations of existing JEPA-based world models and propose a method that combines mixed-span goal supervision with variable-length action chunks to address these limitations.
- The paper demonstrates that the proposed method achieves a higher average success rate than existing methods across four visual goal-reaching benchmarks. The authors also analyze the effectiveness of key components and the characteristics of the model through various experiments.
Critical weaknesses
Although the authors claim that the use of variable-length action chunks is one of the main contributions of the paper, a major weakness is that its effectiveness has not been clearly validated.
- Although FlexiWorld is trained with variable-length action chunks, the evaluation only uses fixed chunk lengths, such as k=5 or k=10. Since the authors do not evaluate scenarios where different chunk lengths are used together during planning, the benefits of variable-length training have not been sufficiently validated.
- Performance improvements can be observed when variable-length chunks are used in the single-span setting. However, the effectiveness of variable-length chunks has not been independently validated under mixed-span supervision. Furthermore, since applying mixed-span supervision alone to INTACT improves the success rate from 46.58% to 54.42%, the independent contribution of variable-length chunks to the performance improvement remains unclear. Additional experiments directly comparing fixed-length and variable-length chunks under mixed-span supervision, while maintaining the same action architecture and Student Forcing setting, would be necessary.
- FlexiWorld's performance improvement may result from including transitions longer than k=5 during training, rather than from the diversity of chunk lengths. The current ablation study only compares fixed-length chunks with variable-length chunks. An additional comparison with fixed-length chunks using larger values of k would help more clearly isolate the contribution of variable-length chunks.
Questions for authors
- Although the model is trained with variable-length chunks, the evaluation only uses fixed chunk lengths, such as k=5 or k=10. It would be interesting to see whether performance is maintained or improved when multiple chunk lengths are mixed or randomly varied within the same trajectory. This would help determine whether the benefits of variable-length training also extend to actual variable-length chunk schedules.
- It would be interesting to examine how sensitive the method is to the choice of goal spans S={35,55,75} used during training. It remains unclear whether the performance improvement comes from the diversity of using multiple goal spans or from the specific combination of temporal distances {35,55,75}. To investigate this, it would be useful to evaluate whether the performance improvement is maintained with different span combinations or when goal spans are randomly sampled.
3 comments
Thank you for conducting the additional experiments. The new results demonstrate that variable-length training can outperform fixed-length training, which partially addresses my previous concerns.
However, it remains unclear which aspects of variable-length training actually contribute to the performance improvements. In particular, the nearly identical performance of variable-length training with ranges of 1–5 and 1–10 is an interesting observation, but the authors do not provide a sufficient interpretation of this result. Although the authors emphasize the benefits of jointly learning latent dynamics and goal-conditioned action generation across multiple temporal scales, the current experiments do not clearly establish which aspects of this training strategy are responsible for the observed improvements. Given that variable-length training is emphasized as one of the paper's main contributions, it would be helpful to further clarify its distinctive advantages over existing approaches and provide more insight into its technical significance beyond the modification of the training strategy.
Thank you for acknowledging the benefit of variable-length training.
The similar performance of 1–5 and 1–10 shows that the improvement does not require training transitions longer than five actions. Both configurations learn across multiple durations; increasing the maximum training duration need not improve fixed-five evaluation.
The matched fixed-five versus full-method comparison holds architecture, goal spans, Student Forcing, and chunk count constant, yielding a 7.42% gain. Different partitions expose the actor and predictor to different intermediate transitions toward the same goal.
Beyond training, FlexiWorld removes the fixed-duration constraint from action generation and latent prediction. Its variable-length encoder and autoregressive actor allow one trained model to change imagined transition resolution without retraining, as demonstrated by our planning-resolution experiments. This could support robotic deployment with finer transitions when control precision matters, or coarser transitions to reduce planning computation when efficiency is the priority.
Dear Reviewer h4Lj,
Thank you again for your concrete experimental suggestions. In response, we added the fixed-five training control under matched architecture, mixed-span supervision, and Student Forcing; a variable-length training experiment capped at five actions; mixed-duration planning evaluations; and an alternative training-span setting, {40,60,80}. These results are presented in our individual response and the response to all reviewers.
We would appreciate your feedback on whether these additions address your concerns about variable-length training and sensitivity to the chosen goal spans. If any specific concerns remain, could you let us know soon so that we can address them before the discussion period ends?