- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TRAC, which adds two objectives to a flow-matching VLA on its clean-action estimates: a weighted prefix-consistency loss on accumulated translations and a local residual-structure prior on trend-removed action windows, so that relations within a chunk are supervised rather than only per-action error. On LIBERO with SmolVLA, TRAC improves a clean-action baseline by 3.4 points, with further results on various simulation and real-world tasks.
Critical strengths
- The prefix-consistency objective is correct and fully characterized. A positive-definite quadratic metric on translation errors whose unrestricted optimum is the unchanged conditional mean, which makes its effect transparent and its cost zero at inference.
- The evaluation is comprehensive, covering two backbones, a perturbed benchmark, a horizon sweep, held-out prediction error, and a real robot, and the prefix gain reproduces on the GR00T adaptation.
Critical weaknesses
- The evidence for TRAC cannot reliably separate its objectives from the clean-action reparameterization. The held-out error analysis, the SmolVLA results on LIBERO-Plus, and the real-robot results all compare TRAC with the original SmolVLA instead of the clean-action baseline.
- The proposed structural prior is not evident to justify its complexity. On SmolVLA, it has almost no impact on success, either alone or on top of prefix supervision. Moreover, the baselines in those comparisons use a single seed. Its gain on the GR00T adaptation is larger, but none of its settings in Table 7 are ablated, so it is unclear which parts of it matter.
Questions for authors
- Can you report Table 3 and Figure 4 for the clean-action baseline and for prefix-only, together with the per-step error in Appendix E.1? The question is whether the ratio of prefix error to per-step error falls under TRAC, since that ratio is what better composition means.
- What do the clean-action baseline and the prefix-only variant reach on LIBERO over three seeds, and what does the clean-action baseline reach on LIBERO-Plus and on the four real tasks?
- How are the settings within Table 7 chosen and on what data, and what fraction of windows incur a nonzero structural penalty at convergence?
- Which robot, cameras, control rate, and chunk length were used in Section 4.3, and is the SmolVLA column of Table 2 the velocity head or the clean-action head?
- The Loss Computation and Aggregate parts of Figure 2 do not render in any PDF viewer I tried, and copying the labels yields unmapped glyphs. Please describe their content and embed the figure text as fonts or outlines.
Q1 Prefix error relative to per-step error
The prefix-to-per-step error ratio falls relative to clean-action, and most of this reduction comes from prefix supervision.
The comparison uses 40,000 chunks per configuration with H=15. Relative to clean-action, full TRAC reduces the MAE ratio by 7.59% and the MSE ratio by 20.87%.
Prefix-only already gives nearly the same MAE ratio and a slightly lower MSE ratio than full TRAC. These diagnostics therefore attribute the reduction in relative error accumulation mainly to prefix supervision.
Appendix F.1, Tables 12–13 and Figures 6–8, reports the per-step and prefix errors. Appendix F.2, Table 14 and Figures 9–10, reports the ratios.
Q2 Three-seed and clean-action controls
The same three-seed means are 93.38% for clean-action, 95.50% for prefix-only, and 96.60% for TRAC.
All entries are success rates (%); standard deviations are population standard deviations across the three training seeds. Appendix E.5 reports the results obtained using the same three training seeds. The structural term improves success over prefix-only by 1.05, 1.20, and 1.05 points.
The added LIBERO-Plus control is:
All entries are success rates (%). TRAC improves Goal and Object, while Long and Spatial are lower.
The real-robot comparison uses 20 trials per task:
The robot results show an observed gain of 12.50 points over clean-action, with higher success on all four tasks.
Q3 Parameter selection and penalty activity
The Table 7 settings were developed incrementally on LIBERO and then kept fixed across models and datasets. There was no separate hyperparameter search.
At the final checkpoint, the structural penalty is nonzero in 40.29% of valid windows. We analyze 4,000 action chunks (1,000 batches of four), yielding 6,917 valid windows using the training noise/time sampling procedure (Appendix F.4). For the constraint shown in panel (a), 40.29% are active overall (2787/6917). Near the noise endpoint (0≤t≤0.1), 93 of 1,020 valid windows are active, or 9.12% within that region. These 93 windows account for 1.34% of all valid windows (93/6917). Our one-step sampler directly uses the clean-action prediction at t=0 for execution, making its quality important for task success.
Q4 Robot setup and the Table 2 baseline
We use a Galaxea R1 robot with wrist-mounted RealSense D405 cameras and a head-mounted ZED camera. Actions are executed at 15 Hz, and the action chunk length is 15.
The original SmolVLA column in Table 2 uses the velocity prediction head. The expanded comparison separately identifies velocity, clean-action, and TRAC, with 52/80, 61/80, and 71/80 successes, respectively.
Q5 Figure 2 rendering and content
Figure 2 has been converted to address the rendering issue. Loss Computation calculates the squared difference between predicted and demonstrated cumulative translations at each prefix. Aggregate combines these errors using the specified prefix weights to form the prefix-consistency loss.