- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
In this paper, the authors propose a new method for using asynchronous denoising of WM and action tokens in WM-added VLA models. During training, they use modality-decoupled noising. And during inference, they first denoise the visual tokens a little bit for priming, then begin action denoising when a inter-step KL threshold is crossed. They also add a remasking method to revisit action tokens which have lower confidence.
Critical strengths
The paper aims to solve a problem that is important in world-modeling VLAs, and their method gives novel analyses of how exactly decoupled denoising schedules should be done. Their method is quite intuitive.
Critical weaknesses
(1) Formatting and writing : The writing in this paper is quite hard to follow and does not lead naturally from concept to concept. I am genuinely interested in the problem this paper aims to fix, yet I had to spend a long time to parse what exactly the authors intended to do. The introduction gives a few analyses for motivation, but its hard to understand what exactly the analyses are supposed to be showing, and how that leads to the method the authors are proposing. The intro is too wordy on things that don't matter without actually giving the reader guidance on what problem the authors are solving, why its important, and how they solved it. I suggest a near rewrite for actual publication.
- The formatting also needs a overhaul. For example, the real robot experiment results in Fig. 3(c) can't be seen unless you zoom in quite a bit. Also, why no parantheses around citations? Parts like "using Emu3 language tokenizer Wang et al. (2024), a VQ tokenizer Zheng et al. (2022), and FAST Pertsch et al. (2025), respectively" in the method section are hard to read.
(2) Novelty seems limited. Diffusion forcing-style decoupled timesteps have already been used a lot, with asynchronous schedules in papers like DUST. The paper's contribution is limited to the response based transition and the remasking part, which doesn't seem enough a contribution for an ICLR paper.
Questions for authors
The baselines UD-VLA seems to acheieve 4.64 in Table 1 but 4.45 in Table 3? Why is this so?
How much does the vision-first ordering help compared to just simple independent noise sampling?
3 comments
Q1: Baseline discrepancy
Thank you for this question. We clarify that 4.64 is the performance reported in the original UD-VLA paper. When evaluating the officially released checkpoint, we obtain 4.57. However, our independent SFT reproduction yields 4.43–4.45 across both 4×A100 and 4×A800 GPUs, indicating that the discrepancy is not attributable to GPU hardware.
We further examined the training dynamics and found that the original UD-VLA implementation computes cross-entropy over visual and action tokens jointly. Since visual tokens constitute the majority of output tokens, they contribute disproportionately to the overall training loss (approximately 70–80%), potentially weakening the learning signal for action prediction. To address this imbalance, we introduce modality-wise loss normalization to balance the contributions of the two modalities, helping mitigate the performance gap observed in our SFT reproduction, as evidenced by the ablation results in Table 3.
Q2: Effect of Vision-first Ordering
We evaluate vision-first ordering at both training and inference time, with controlled comparisons to isolate its effect at each stage. All comparisons are conducted without action remasking, as reported in Table VIII .
Table VIII Effect of Vision-First Ordering on CALVIN ABCD→D
| Stage | Configuration | Vision-first Ordering | Avg. Len. ↑ |
|---|---|---|---|
| Training | Shared sampling | — | 4.45 |
| Training | modality-independent sampling & shared inference schedule | ✗ | 4.50 |
| Training | modality-independent sampling & shared inference schedule | ✓ | 4.52 |
| Inference | Asynchronous denoising | ✗ | 4.68 |
| Inference | Asynchronous denoising | ✓ | 4.73 |
During training, vision-first ordering yields a modest improvement from 4.50 to 4.52, as it primarily shapes the distribution of cross-modal noise configurations encountered during training, while the shared inference schedule does not explicitly exploit this visual-first progression. In contrast, applying vision-first ordering during asynchronous inference improves performance from 4.68 to 4.73 (+0.05), as it aligns the denoising progression with our Visual Priming strategy.
I thank the authors for the detailed response and additional experiments. However, with W1, I appreciate the format changes, but the revised manuscript does not really fix my concerns with the writing, especially in the introduction. There is little deviation from the original structure, leaving it longer rather than clearer for the reader, while figures' legibility is low across the paper. In addition, the novelty concerns I have still stand, since the points the authors gave in their rebuttal are still incremental at best.
Overall, the paper has some merits, but given the novelty issue and weakness in writing, I would require some surprising performance gains across benchmarks for this paper to merit a higher score, but the gains in this paper are marginal in my opinion. Hence, I keep my score as 2.
We appreciate the reviewer’s recognition of the importance of the problem we address in world-model-augmented VLAs, as well as the value of our analyses on decoupled denoising schedules. We have also carefully considered the reviewer’s constructive feedback on the presentation and substantially revised the Introduction in the updated PDF to improve the clarity of our problem formulation and motivation. We address the comments point by point below.
W1 : Formatting and writing
We thank the reviewer for this insightful comment. In response to your feedback, we have further refined the logical flow of the Introduction. For clarity, we summarize the key logic below:
Problem: Modality Heterogeneity. In unified discrete-diffusion VLAs, future-visual tokens serve both as generation targets and as evolving conditions for action prediction. However, visual and action tokens are denoised under a shared schedule despite their distinct functional roles and recovery characteristics.
Analysis 1 (Fig. 1(a)) → Modality-specific Recovery Dynamics. Under the shared schedule, visual tokens recover earlier and dominate cross-modal confidence ranking, while action tokens remain largely masked until later stages and are then committed rapidly. This heterogeneous recovery limits progressive action refinement, motivating modality-decoupled training and asynchronous inference.
Analysis 2 (Fig. 1(b)) → Sample-dependent Cross-modal Response. The onset of action-distribution changes varies across samples as visual tokens are progressively recovered, revealing sample-dependent sensitivity to evolving visual context. This motivates a sample-wise adaptive strategy that adjusts vision–action coordination by determining when to initiate action denoising based on each sample's action-response signal, rather than following a fixed schedule.
Incomplete Visual Context → Action-centric Reconsideration. During Stage II, visual and action tokens interact throughout asynchronous joint denoising, while visual tokens continue to be progressively recovered. Consequently, early action predictions may be formed under incomplete visual context, potentially leading to misleading action-token commitments. This motivates Action-centric Reconsideration, which revisits previous action predictions as richer visual information becomes available.
We have refined the Introduction to better establish the connections between our motivating analyses, the central research gap, and our methodological design. These revisions are highlighted in blue in the updated PDF.
Regarding figure readability, we have enlarged the quantitative results in Fig. 3(c) to improve their legibility. Regarding the citation style, we acknowledge this oversight and have corrected the formatting throughout the revised manuscript, ensuring that all in-text citations consistently follow the parenthetical style.
W2: Novelty.
We thank the reviewer for raising this concern. We would like to clarify that our contribution is not to introduce asynchronous denoising itself, but to address a further underexplored challenge: adaptive cross-modal coordination under sample-dependent and evolving visual conditions. While existing approaches (e.g., DUST and X-WAM) establish modality-specific denoising schedules, they lack a sample-wise adaptive mechanism for coordinating vision and action. Specifically, it remains unclear when action denoising should begin in response to evolving visual context of each sample, and how previously committed action predictions should be revised as this context continues to evolve.
To better address the your concern, we summarize our contributions as follows:
The above contributions form a coherent framework centered on our core research question of adaptive cross-modal coordination, rather than merely combining existing techniques.