- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces Urgency-Aware Denoising (UAD), an inference-time framework for flow-matching Vision-Language-Action (VLA) policies that exploits the temporal asymmetry between joint action generation and sequential physical execution. UAD enables early release of urgent actions while overlapping subsequent denoising with physical execution. To address the resulting action errors and trajectory inconsistencies, it introduces Trajectory Reconciliation (TR) to restore coherent joint denoising states and Ghost Action Correction (GAC) to compensate for early-release deviations. Experiments across multiple VLA architectures, simulation benchmarks, and real-world manipulation tasks demonstrate improved action availability latency while maintaining task success rates comparable to standard inference.
Critical strengths
The paper identifies a meaningful mismatch between joint action-chunk generation and sequential physical execution, challenging the assumption that an entire chunk must be fully denoised before execution begins. By distinguishing when individual actions are needed from when the complete chunk is refined, it introduces an execution-aware perspective on VLA inference efficiency. This approach reduces action availability latency by overlapping background denoising with physical execution, without reducing the total number of DiT evaluations. The explicit latency analysis further clarifies when such overlap is effective. More broadly, this work highlights the importance of considering computation–execution coordination, rather than model-level inference cost alone, when optimizing generative robotic policies.
Critical weaknesses
-
The additional value of TR beyond the (K=1) setting remains unclear. All main experiments use (K=1), where TR exactly recovers the vanilla internal trajectory. In this case, UAER+TR is effectively equivalent to releasing urgent actions after the first denoising step while continuing standard vanilla denoising in the background. Although Fig. 3 shows that TR reduces tail-action errors at (K=2), Fig. 5 does not demonstrate a consistent success-rate or latency advantage for larger (K). Since (K=1) already achieves a strong success-latency trade-off, it remains unclear when the more general TR mechanism for (K>1) would be beneficial or what additional practical value it provides.
-
The reported real-world speedup lacks a performance-matched vanilla baseline. While simulation experiments employ empirically optimal denoising budgets (), the real-world evaluation compares UAD only against vanilla inference with (N=10) and (N=1). Given the non-monotonic relationship between denoising steps and task success, intermediate budgets may achieve comparable performance at lower latency. Without such comparisons, the reported (2.26$\times$) speedup does not establish UAD's advantage over a properly tuned vanilla baseline at matched task performance.Ask only questions whose answers could materially affect your assessment. Distinguish clarification requests from suggestions for future work.
Questions for authors
Q1. Is TR necessary in the main (K=1) setting, or could a simpler early-readout implementation achieve the same result?
At (K=1), TR exactly reconstructs the vanilla internal trajectory. Could the authors confirm whether simply releasing the first-step urgent actions while continuing vanilla denoising would produce the same results? If so, what distinguishes TR from this simpler implementation, and is per-action time conditioning actually necessary at (K=1)?
Q2. If (K=1) already achieves the best success-latency trade-off, when and why would (K>1) be useful?
Fig. 3 shows that TR reduces tail-action errors at (K=2), but Fig. 5 shows no consistent performance improvement with larger (K). What practical scenarios would favor (K>1) over (K=1)? Could the authors provide component-wise ablations at (K>1) to show whether TR and GAC independently improve task success, rather than merely reducing action-space errors?
Q3. Does the reported (2.26$\times$) real-world speedup hold against a performance-matched vanilla baseline?
The paper selects empirically optimal denoising budgets () in simulation but compares real-world UAD only against the default vanilla (N=10). Could the authors evaluate intermediate denoising budgets and identify the smallest (N) achieving approximately (84%) success? How does its action availability latency compare with UAD?
Q4. Does GAC correct actual physical-state deviations or only compensate for command discrepancies?
GAC redistributes differences between ghost and released actions without observing the robot's realized state. Can the authors demonstrate whether these discrepancies correlate with actual physical-state errors and whether GAC reduces such errors? Given that GAC is disabled in real-world experiments due to the action representation, could the authors further clarify its applicability to contact-rich tasks and different action representations?
3 comments
Thank you for the detailed rebuttal and additional experiments. My main concern remains the practical relevance of TR. While the new results demonstrate that TR can improve trajectory fidelity at K>1, the empirical evidence still suggests that K=1 provides the most favorable success-latency trade-off. Importantly, the authors acknowledge that TR is mathematically equivalent to continuing vanilla denoising at K=1, without requiring per-action time conditioning.
This raises a fundamental question about the practical contribution of TR: if the empirically preferred setting does not require TR, while the settings where TR becomes non-trivial offer no consistent success-latency advantage, what is the practical motivation for introducing this mechanism? I acknowledge the technical validity of TR at K>1, but remain unconvinced that its added complexity translates into a meaningful practical benefit under the evaluated settings. Therefore, I maintain my current rating at this stage.
Thank you for your continued engagement during the rebuttal phase and for your careful assessment of our paper. We agree that the success-rate gains from increasing K are setting-dependent. In the revised Fig. 17, K=2 yields higher observed success rates than K=1 at every tested U on SmolVLA + Meta-World+, at the cost of longer action waiting time. On LIBERO-Plus, we observe no consistent improvement in success rate as K increases.
As a study of inference acceleration, our work does not directly address how to improve the underlying policy’s success rate. We take vanilla inference as our reference and aim to reproduce its behavior as closely as possible while letting the robot begin acting sooner. Our rationale is that reducing deviations from the reference can help limit any loss in success rate due to acceleration. At K>1, TR reduces these trajectory deviations in our experiments, although smaller deviations do not always lead to higher success rates. We recognize that this limits how convincingly our experiments can demonstrate TR’s practical value. Given our focus on accelerating the vanilla policy, we do not see a clear way to better preserve its success rate beyond matching its trajectories as closely as possible.
Thank you again for taking the time to read and discuss the additional results with us.
Response to Reviewer 92rj
We thank the reviewer for recognizing UAD’s motivation, execution-aware design, and latency analysis. We appreciate your constructive suggestions on TR’s practical value, the real-world baseline, and GAC’s physical validity.
W1/Q1. Equivalence to early readout at K=1.
We agree that, at K=1, UAER+TR is mathematically equivalent to computing an urgent-action readout from the first velocity while continuing vanilla denoising internally. Per-action time conditioning is unnecessary in this special case. Section 4.3 now explicitly acknowledges this equivalence. TR also supports K>1, where additional denoising of urgent actions improves fidelity to the vanilla reference, as demonstrated by our new experiments.
W1/Q2. Practical value and component ablations at K>1.
We have added physical-state measurements showing that increasing K from 1 to 2 reduces EE position errors in both tested SmolVLA settings (Section 5.2, Fig. 5). We have recorded physical states after each executed action within a chunk and compared them with the corresponding vanilla reference. The table below reports EE position errors (mm) for SmolVLA on LIBERO-Plus:
Increasing K improves physical trajectory fidelity across the tested settings, with setting-dependent effects in task success: full UAD’s SR increases by 2.8 pp on Meta-World+ and decreases by 1.0 pp on LIBERO-Plus. K>1 therefore provides an option when closer fidelity to the vanilla trajectory is prioritized over minimum waiting latency.
We have also added component-wise ablations at K=2 in both SmolVLA settings (Fig. 7). TR improves SR over UAER alone, and GAC provides further gains, demonstrating practical benefits beyond action-space error reduction and the exact-recovery case of K=1. Section 5.2 discusses the relationship between physical trajectory fidelity and task success.
W2/Q3. Real-world comparison against a tuned vanilla baseline.
We thank the reviewer for pointing out this oversight and helping us ensure a fair comparison. Comparing against the default N=10 alone does not establish an advantage over a tuned baseline. We have now evaluated N=1,…,10 in real-world deployment (Appendix A, Fig. 9). Following the same selection criterion as in simulation, N*=5 is the smallest budget attaining the highest observed SR, 86%.
The revised Table 2 compares UAD against Vanilla (N∗=5): UAD achieves 85% SR versus 86% for Vanilla, while reducing AAL from 20.5 to 14.6 ms, yielding a 1.40× speedup. We have replaced the original 2.26× comparison against N=10 with this tuned-baseline result, demonstrating an action availability advantage at comparable observed task performance.
Q4. GAC’s physical-state effects and applicability.
Under incremental spatial commands and approximate controller tracking, released actions can estimate the resulting motion in free-space execution. Differences between ghost and released actions therefore provide an estimate of physical deviations from the vanilla reference without directly observing the realized state. During contact or grasping, constraints or irreversible changes may invalidate this estimate. GAC aims to reduce compensable residual errors through subsequent movements. As stated in Section 4.4 of the original submission, executed urgent actions cannot be corrected retroactively.
We have added physical-state measurements to examine this connection and evaluate the correction effect. We have recorded physical states after each executed action and compared them with the vanilla reference, sampling throughout episodes, including contact and grasping phases. As shown in the table above, adding GAC to UAER+TR reduces EE position error from 5.95 to 1.94 mm at K=1 and from 3.17 to 1.09 mm at K=2 on SmolVLA+LIBERO-Plus. These results support the relevance of command discrepancies to compensable physical errors and directly demonstrate that GAC reduces realized deviations. Fig. 5 presents per-action curves for both benchmarks, while Appendix D.5 reports additional EE orientation and gripper-state measurements.
We have expanded Appendix E to clarify two applicability issues. Action representation: GAC’s cumulative compensation applies to incremental spatial commands. Our real-world deployment uses shared-reference targets, so urgent command deviations do not accumulate into subsequent targets; we therefore use UAER+TR without GAC. Contact-rich interactions: our measurements include contact and grasping phases, while irreversible changes remain a limitation shared by acceleration methods that execute approximate actions during sensitive interactions. Drawing on existing studies, we discuss selective fallback based on predicted gripper transitions or collision risks, reverting to full denoising when needed as a potential mitigation.