- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AT-RoPE, an action-conditioned encoding method that augments the original positional encoding. It composes learned orthogonal transformations in action-sequence order to explicitly incorporate information from preceding candidate actions. For WAM backbones, a complementary pathway also conditions query–key matching on the actions being compared. The authors evaluate the method on four backbones and multiple benchmarks, reporting improvements in average success rates.
Critical strengths
-
The paper studies an interesting topic in embodied AI: how to encode action sequences. Standard RoPE provides positional information, while robot control also depends on the content and execution order of actions. Exploring ways to encode this structure more explicitly is worthwhile.
-
The experiments are extensive, covering four backbones, multiple simulation benchmarks, and real-robot tasks.
-
The paper is generally well written, and the main idea is easy to follow.
Critical weaknesses
-
My main concern is sensitivity to errors in earlier candidate actions. Although the prefixes are recomputed at each refinement step and incorporated through gated residual updates, they are still built from potentially incorrect candidate actions. Could this additional dependence make an incorrect action chunk harder to revise? Targeted tests of plan correction and recovery from execution failures would help clarify this concern.
-
I am also concerned about task-irrelevant variation in demonstration actions. The paper already includes noisy-action training and robustness evaluations, but these do not directly isolate whether the added prefix pathway learns unnecessary dependencies on incidental movements in the demonstrations. A controlled comparison with and without such variation would help assess this possibility.
-
The settings of the optional VLA components are not fully clear. Algorithm 1 and Appendix B.1 describe observation-derived coefficient conditioning and prefix-derived query tokens, but I could not find which options were enabled for each reported VLA configuration. The paper states that paired comparisons retain the native backbone settings; please also specify the settings of these added components.
-
Some main-benchmark gains are small, and their uncertainty is not reported. For example, Table 1 shows LIBERO average success increasing from 99.3% to 99.4% for OpenWAM-α and from 96.9% to 97.4% for π0.5. Figure 4 provides useful five-run means and standard deviations for the separate prefix ablation, but these do not establish the variability of the Table 1 results. Reporting training-run variability and evaluation confidence intervals for the main comparisons would help assess whether these small improvements are reliable.
Questions for authors
See weakness.
7 comments
Response W2. Sensitivity to task-irrelevant demonstration variation
Response W2. Sensitivity to task-irrelevant demonstration variation
1) Controlled training-data comparison
Training conditions. We train Fast-WAM with and without AT-RoPE using reference demonstrations and demonstrations containing task-irrelevant movement variation, yielding four model–training-condition combinations.
Evaluation scope. Each configuration is evaluated over 500 trials, directly testing sensitivity to training-demonstration variation rather than inference-time candidate noise.
2) Performance and relative sensitivity
Retained performance advantage. AT-RoPE outperforms the baseline under both conditions, with its advantage increasing from 2.2 points on reference demonstrations to 2.8 points on varied demonstrations.
Smaller observed decrease. Introducing the variation reduces success by 0.8 points with AT-RoPE versus 1.4 points for the baseline, a 0.6-point smaller decline.
Table K. Task success under reference and varied-demonstration training. Counts are successful trials/total trials; changes and advantages are in percentage points.
| Policy | Reference demonstrations | Varied demonstrations | Change |
|---|---|---|---|
| Fast-WAM baseline | 78.8% (394/500) | 77.4% (387/500) | −1.4 |
| Fast-WAM + AT-RoPE | 81.0% (405/500) | 80.2% (401/500) | −0.8 |
| AT-RoPE advantage | +2.2 | +2.8 | +0.6 |
3) Connection to the design and correction study
Adjustable prefix dependence. The learned gated residual update adjusts the contribution of prefix-conditioned features while retaining the native token representation and prediction objective (manuscript Eq. (5)).
Complementary diagnostics. W1 tests correction of corrupted candidates during inference, whereas this experiment shows that AT-RoPE retains its task-performance advantage under the tested variation in training demonstrations.
Response W3. Settings of the optional VLA components
Response W3. Settings of the optional VLA components
1) Enabled and disabled options
Observation conditioning: enabled (b_c = 1). Both π₀.₅ and StarVLA-π use observation context from native prefill together with current candidate actions to condition the operator coefficients.
Prefix-derived query tokens: disabled (b_f = 0). The optional query sequence is empty, so the decoder suffix contains exactly transported action tokens; ordered token transport remains enabled.
2) Token transport and gating
Operator settings. Both VLA integrations use 512 transported channels, p = 4, and K = 4 generators shared across blocks.
Token gate. The gate uses only token features, , with s_h = 1 and the explicit action/time gate terms set to zero. Action conditioning remains in the operator coefficients, and native decoder time conditioning is retained.
Local Q/K modulation. This pathway is used only in WAM integrations, not in either reported VLA model.
Table L. Fixed AT-RoPE settings for the reported VLA configurations, shared across each backbone's evaluations. Generators are shared across feature blocks.
| Added-component setting | π₀.₅ | StarVLA-π |
|---|---|---|
Observation-derived coefficient conditioning, b_c | Enabled (1) | Enabled (1) |
Prefix-derived query tokens, b_f | Disabled (0) | Disabled (0) |
| Additional query-token count | 0 | 0 |
| Ordered token transport | Enabled | Enabled |
| Transported feature channels | 512 | 512 |
| Block width, p | 4 | 4 |
| Number of generators, K | 4 (shared) | 4 (shared) |
| Token-gate conditioning | Token features; s_h = 1 | Token features; s_h = 1 |
| Local post-RoPE Q/K modulation | Not used | Not used |
3) Consistency across evaluations
Fixed added-component configuration. All reported π₀.₅ and StarVLA-π evaluations use the settings above, including π₀.₅'s RoboTwin and real-robot experiments, without benchmark-specific tuning of these components.
Checkpoint reuse. For π₀.₅, the same checkpoint trained on the four LIBERO suites is reused for LIBERO, LIBERO-Pro, and LIBERO-Plus.
Native versus added settings. “Retaining native backbone settings” refers to the data-processing pipeline, optimizer, learning-rate schedule, training updates, and native inference configuration; Table L explicitly specifies the added components described in Algorithm 1 and Appendix B.
Response W1. Correction of corrupted candidate actions
Response W1. Correction of corrupted candidate actions
Evaluation scope. We compare Fast-WAM with and without AT-RoPE on RoboTwin, using 900 cases per model.
Targeted intervention. At the fifth step of ten denoising steps, we perturb the first 25% of the candidate chunk with Gaussian noise on non-gripper dimensions, scaled by one per-dimension action scale, then continue joint refinement normally.
Matched conditions. Within each model, perturbed and unperturbed runs share the same initial noise, and both models receive matched perturbations in physical action units.
Metrics. We measure normalized prefix recovery R and the perturbation-induced change in demonstration-referenced error over the segment selected for execution:
R &= 1 - \frac{\operatorname{RMS}_{P}(a_{\mathrm{pert}}-a_{\mathrm{clean}})}{\operatorname{RMS}_{P}(\delta_{\mathrm{eff}})}, \\\\ \Delta\mathrm{MSE}_{X} &= \mathrm{MSE}_{X}(a_{\mathrm{pert}},a_{\mathrm{demo}}) - \mathrm{MSE}_{X}(a_{\mathrm{clean}},a_{\mathrm{demo}}). \end{aligned}$$ where $P$ is the perturbed prefix, $X$ is the execution segment, and $\delta_{\mathrm{eff}}$ is the applied perturbation; $a_{\mathrm{pert}}$ and $a_{\mathrm{clean}}$ are the final predictions with and without intervention. Thus, $R=1$ denotes complete removal of the injected deviation relative to the unperturbed prediction. **Comparable perturbation tolerance.** AT-RoPE and the baseline achieve closely matched normalized prefix recovery of **99.642% and 99.630%**, respectively. The added prefix pathway therefore preserves the baseline's ability to correct corrupted candidates, with **no observed increase in sensitivity or fragility under the tested prefix perturbations**. **Execution-segment error.** The paired difference in perturbation-induced $\Delta\mathrm{MSE}_{X}$ is close to zero, with its 95% confidence interval spanning zero. **Table J. Recovery from intermediate prefix corruption on RoboTwin using Fast-WAM (900 cases per model).** Paired effects are AT-RoPE minus baseline; CI denotes the 95% confidence interval. **(a) Normalized prefix recovery** | Metric | Baseline | AT-RoPE | |---|---:|---:| | Normalized recovery, $100R$ (%) | 99.630 | **99.642** | **(b) Paired effects** | Paired effect | Estimate | 95% CI | |---|---:|---:| | Recovery difference $\Delta R$ (×10⁻⁴) | +1.12 | [+0.47, +1.84] | | Difference in $\Delta\mathrm{MSE}_{X}$ (×10⁻⁶) | +2.00 | [−6.20, +10.00] | **Connection to the design.** The measured recovery is consistent with reconstructing prefixes from updated candidates at every refinement step, rather than retaining corrupted prefixes as fixed commitments. > ### 3) Complementary task-level evidence **Evaluation scope.** The intervention isolates intermediate candidate correction, while benchmark and real-robot evaluations provide complementary evidence from complete task execution. **Benchmark performance.** AT-RoPE improves benchmark-average success for **all four backbones on RoboTwin 2.0** (manuscript Table 3). **Real-world performance.** Success increases from **65% to 80%** for object packing, **20% to 90%** for cylinder insertion, and **20% to 75%** for dynamic object manipulation (Figure 5). **These results show that preceding-action conditioning improves task performance while retaining effective candidate correction under the tested prefix perturbation.**