- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LeapBot-JAC, a method for reorganizing a fixed action-token budget within existing world-action models. It replaces a sequence of 32 dense action targets with 16 sparse future-control references and 16 dense execution targets. The two chains share an action expert and are jointly denoised, using physical-time positional encoding and directed attention that allows execution tokens to read reference tokens. Only the execution prefix controls the robot. Evaluations on FastWAM and LeapBot-WA cover LIBERO, zero-shot LIBERO-Plus, RoboTwin, and two real-world tasks. The largest improvements occur on LIBERO-Plus, while measured model-call latency and memory remain nearly unchanged. Ablations investigate attention direction, reference-supervision weight, and reference stride.
Critical strengths
The paper addresses an interesting and practically relevant question: how to use a fixed action-token budget when only a prefix of the predicted sequence is executed. I appreciate the simplicity of the proposed design and the empirical evidence that reorganizing prediction targets can improve performance without expanding the model.
- A concrete and economical allocation of prediction roles. JAC combines dense near-term execution targets with sparse references spanning a longer future interval within a single shared expert. Physical-time alignment and directed visibility provide a clear implementation of this organization. The method preserves the action-token count, parameter count, and generation steps, making it a potentially useful modification to existing world-action models.
- Consistent robustness improvements across two hosts, supported by real-world evaluation. On zero-shot LIBERO-Plus, success improves from 53.5% to 70.4% for FastWAM and from 73.1% to 77.3% for LeapBot-WA, with improvements across all seven perturbation categories for both hosts. The two real-world tasks provide additional support, with 200 evaluation trials per model per task. These results are consequential because they extend the evidence beyond small improvements on standard LIBERO.
Critical weaknesses
Although the overall results are encouraging, the current evidence does not sufficiently isolate the contribution of the proposed reference–execution organization or establish the reliability of several reported improvements. The manuscript acknowledges important limitations, but these limitations still affect the strength of its central conclusions.
- The specific contribution of sparse references and directed reference-to-execution access remains insufficiently established. JAC changes target allocation, temporal coverage, positional encoding, attention visibility, and loss weighting together. The current controls do not separate these effects. In Table 3, the default reference-to-execution configuration achieves 98.3%, while reverse access achieves 98.2%, despite preventing execution tokens from directly reading reference tokens. These results leave the additional benefit of the proposed forward-conditioning mechanism unresolved; auxiliary supervision and shared-parameter optimization remain plausible explanations. Matched controls, such as a loss-reweighted single chain and a repeated-near-term reference variant, would help establish the contribution of sparse future references. This attribution is particularly important given related joint intention–action generation approaches such as LAWA [1].
- Training variability and incomplete deployment reporting limit the strength of the empirical conclusions. All local experiments use a single training seed, and success rates are reported without uncertainty estimates. Consequently, the small RoboTwin improvements and the narrow differences between attention or stride configurations do not establish reliable advantages. The four real-world evaluation rounds increase the number of trials but do not characterize training variability. Moreover, the strongest gains occur on LIBERO-Plus, whereas the mechanism ablations are conducted on LIBERO. The real-world evaluation is valuable, but important details—including the robot platform, demonstration counts, and control and replanning settings—are insufficiently specified for reproduction.
[1] Xiang Li et al. Latent Action as Intention Enables Efficient Future Imagination for World Action Models. arXiv preprint arXiv:2608.24882, 2026.
Questions for authors
-
Could you provide matched controls that separate the effects of sparse future references from near-term loss reweighting and auxiliary supervision? In particular, comparisons with a loss-reweighted single chain and a reference chain that repeats near-term targets would help determine whether the longer reference span and distinct prediction roles are necessary.
-
How consistently does the default reference-to-execution configuration outperform reverse or disconnected attention across independent training seeds? Could these comparisons also be evaluated on LIBERO-Plus, where the largest improvements are reported? Please provide uncertainty estimates for the main performance differences.
-
Could you specify the robot platform, sensor setup, number of training demonstrations, control frequency, and replanning interval used in the real-world experiments? Please also clarify how initial conditions were selected and matched across methods and evaluation rounds, so that the reported deployment results can be reproduced and interpreted.
[1] Xiang Li et al. Latent Action as Intention Enables Efficient Future Imagination for World Action Models. arXiv preprint arXiv:2608.24882, 2026.
5 comments
Thank you for the substantive responses and additional experiments. The loss-reweighted single-chain and near-term-reference controls, together with the attention ablations on LIBERO-Plus, provide useful evidence for the contribution of sparse future references and directed reference-to-execution conditioning. The additional real-world deployment details also improve the clarity of the evaluation protocol. Please incorporate the new results, control settings, and deployment details into the revised manuscript.
Response to Reviewer fHF2
Thank you very much for your positive feedback and for recognizing the value of our additional experiments and responses. We have carefully considered your suggestions and incorporated the new experimental results, control settings, and real-world deployment details directly into the revised manuscript.
Specifically, we have added cross-chain attention ablations on LIBERO-Plus, extended the reference-weight and temporal-stride ablation analyses, and introduced a loss-reweighted single-chain control and a near-term-reference configuration to better isolate the contribution of sparse future references. Meanwhile, we have incorporated the motivation behind our real-world task designs, together with more comprehensive details of the robot platform, sensors, demonstration data, control frequency, replanning protocol, and initial conditions. In addition, we have conducted backbone transfer experiments on Flex-π and π0.5 to further investigate the transferability of JAC to other high-performance WAM and VLA architectures, and clarified the compatibility limitations of other candidate backbones under our current experimental configurations. We have also further refined our discussion of future predictions and the role of reference chains to clarify the methodological scope and applicability of JAC.
All these changes have been incorporated into the corresponding sections, tables, and figures of the revised manuscript. We sincerely appreciate your constructive suggestions and careful review, which have helped us substantially improve the experimental completeness, clarity, and overall presentation of our work. We hope that the revised manuscript adequately addresses your concerns, and we would greatly appreciate any further feedback or suggestions you may have.
Response to Reviewer fHF2
We thank the reviewer and respond point by point.
1. Isolating sparse future references. We agree that future coverage must be distinguished from near-term loss reweighting and auxiliary supervision. We added a loss-reweighted single-chain control built on FastWAM. It retains the original 32 consecutive Action Tokens, Action Expert, attention, and physical-time positional encoding, without an R chain. We weight the Flow Matching losses of the first 16 tokens by 1.2 and the remaining 16 by 1.0, using the original valid-token-count normalization and excluding padding tokens. The world-modeling objective, execution length, replanning protocol, and other training/evaluation settings remain unchanged. Results (%) are:
With s=1, R and A target the same near-term steps (0–15), providing a near-term-reference control while retaining two-chain joint denoising. Relative to this control, s=3 improves LIBERO-Plus by 3.7 points; relative to the reweighted single chain, by 10.2 points. On standard LIBERO, s=1 reaches 99.2%/100.0% on Spatial/Object but only 94.6% on Long, versus 97.2% Long at s=3. This pattern is consistent with shorter tasks benefiting from dense local reference and multi-stage tasks benefiting from broader future coverage. These comparisons support distinct reference roles beyond near-term reweighting alone. Unlike LAWA, which learns compact latent-action intentions via a separately pretrained tokenizer, JAC directly reorganizes existing control targets within one Action Expert, without additional annotations or a new tokenizer. We will report the control protocol and clarify the comparison and scope of these controls.
2. R→A interaction on LIBERO-Plus. On standard LIBERO, R→A/No-cross/R↔A/A→R score 98.3/97.7/97.5/98.2%, making directional benefits hard to distinguish. We therefore evaluated four attention configurations on LIBERO-Plus, fixing s=3, λR=0.2, and the Action Token budget:
R→A leads across all seven perturbations and exceeds no-cross, bidirectional, and A→R by 5.6/6.8/10.2 points overall. Against A→R, the improvements are +13.6 Robot, +10.5 Camera, and +14.2 Noise. All variants retain the two-chain reference loss and shared Action Expert, so auxiliary supervision can help even when A cannot read R; this also helps explain A→R's 98.2% versus the 97.0% base on standard LIBERO. R→A additionally lets A access future reference features during joint denoising. Its advantage over disconnected and reverse-access controls supports a distinct contribution from directed conditioning, especially under perturbations. We will include these ablations and clarify the mechanisms.
3. Real-world reproducibility. We used a Franka robotic arm, a wrist-mounted first-person fisheye camera, and a third-person Intel RealSense L515. We collected 60 demonstration videos to fine-tune the deployed model. Cartesian commands ran at 20 Hz, with the underlying Franka service at 1 kHz. Each query executes K=10 actions before replanning. On an RTX 4090D, a serial replan-to-replan cycle takes approximately 0.7 s: 0.50 s execution and 0.20 s inference. Every trial starts from the same predefined robot home pose; objects are randomly placed within ±5 cm front/back and left/right offsets. All methods use the same bounded randomization protocol. We conduct four 50-trial evaluation rounds per model per task (200 trials total), reporting successes divided by 50 for each round. We will add these deployment and evaluation details for reproducibility.