- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Temporal Action-Reasoning Alignment (TARA), a framework that improves VLA policy steerability by aligning action chunks with intermediate subgoals. The method uses heuristic trajectory segmentation to construct subtask and direction annotations and trains flow-matching policies to predict variable-length action sequences corresponding to subgoal completion. Experiments on LIBERO-Plus, OOD-90, and real-world manipulation demonstrate improvements in generalization and instruction following.
Critical strengths
-
The temporal mismatch between high-level reasoning and low-level action execution is an important problem in hierarchical VLA policies.
-
The proposed segmentation and alignment strategy is relatively straightforward and can leverage existing demonstration data.
Critical weaknesses
-
Insufficient evidence for the independent contribution of temporal alignment. The current experiments do not clearly isolate the effects of subgoal annotation, variable-length action prediction, and their combination. This makes it difficult to determine whether the proposed temporal alignment mechanism is responsible for the reported improvements.
-
Limited evaluation of generalization and robustness. The OOD evaluation protocol requires further clarification, and the real-world experiments contain very few trials. These limitations weaken the evidence supporting the broader generalization and robustness claims.
Questions for authors
-
The proposed approach combines subgoal annotations with variable-length action chunking. Steerable Policies [1] explores fine-grained behavioral instructions, while Mixture of Horizons [2] investigates adaptive action horizons. Furthermore, Do What You Say [3] addresses reasoning-action alignment, and LaRA-VLA [4] explores integrating multimodal reasoning into action generation through latent representations. Could the authors clarify the methodological novelty of TARA compared with these approaches, particularly regarding the independent contribution of temporal action-reasoning alignment?
-
The current experiments do not sufficiently isolate the contributions of fine-grained subgoal annotations and variable-length action chunking. Could the authors provide controlled ablations to demonstrate the independent benefits of temporal alignment?
-
The paper mentions training high-level planners using LIBERO-90 demonstrations. Could the authors clarify whether the evaluated OOD tasks are seen by the high-level planner and distinguish low-level policy generalization from generalization of the entire hierarchical system?
-
The real-world experiments include only five trials per task, making the reported improvements difficult to assess statistically. Could the authors conduct more extensive evaluations and investigate robustness to inaccurate subgoal predictions or segmentation errors?
References
[1] Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Control. arXiv 2026.
[2] Mixture of Horizons in Action Chunking. ICML 2026.
[3] Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification. ICRA 2026.
[4] Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models. ICML 2026.
6 comments
Author Rebuttal (Addendum)
Q4: “Robustness to segmentation errors”
As mentioned in our initial rebuttal, we conducted an additional experiment to evaluate TARA's robustness to segmentation errors. Even under substantial segmentation errors, TARA outperforms the uncorrupted baselines. Introducing random boundary jitter to our LIBERO training data, with mean displacements of 25% and 50% of the original segment length (approximately 0.45s and 0.9s, respectively, given a mean segment length of 1.8s), reduces TARA's OOD-90 success rate by only 2.5% and 1.6%, respectively. This demonstrates that TARA remains effective even with substantial segmentation noise.
Author Rebuttal (Addendum 2)
W2/Q4 "real-world experiments contain very few trials"
We have expanded real-world experiments from 3 to 5 tasks and from 15 to 25 trials per method. The two new tasks test generalization to unseen goals and spatial reasoning. Full success is shown, with partial success in parentheses:
| Task | ECoT-Lite-like | TARA |
|---|---|---|
| put the apple on the plate | 0.40 (1.00) | 0.60 (1.00) |
| put the apple in the basket | 0.40 (1.00) | 0.80 (1.00) |
| put the pear on the plate | 0.00 (0.00) | 0.40 (0.60) |
| put the apple on the left plate (NEW) | 0.20 (0.80) | 0.40 (0.60) |
| put the apple next to the banana (NEW) | 0.20 (0.20) | 0.20 (0.80) |
| Average | 0.24 (0.60) | 0.48 (0.80) |
TARA’s average full success rate is 48%, double that of ECoT-Lite-like (24%), and outperforms or ties ECoT-Lite-like on all tasks. Due to robot availability, we could not run the 10 trials per task we proposed earlier. We will extend the real-world evaluation to 10 trials per task in the final version.
Author Rebuttal
We thank the reviewer for their feedback. We are glad to hear that the reviewer finds (a) the temporal mismatch between high-level reasoning and low-level action execution an important problem in hierarchical VLA policies, and (b) our segmentation and alignment strategy straightforward and able to leverage existing demonstration data. To address your concerns, we have run an additional ablation to isolate the effect of temporal alignment. We have clarified the OOD-90 protocol, in particular the role of the planner and the distinction between low-level policy generalization and end-to-end generalization, and clarified the methodological novelty of TARA relative to related work, and added qualitative examples that demonstrate recovery from inaccurate subgoals. We are expanding our real-world experiments to 5-6 tasks with 10 trials each, and running an experiment with corrupted segmentation to test robustness to segmentation errors.
We ablate subgoal annotations and variable-length action prediction and find that both are important for the success of TARA, see below.
These results indicate that neither subgoal annotations nor variable-length action prediction alone explains TARA's improvements.
We include end-to-end zero-shot robustness and generalisation with LIBERO-Plus Figure 3 (right) and our real-world experiments (Figure 4). TARA outperforms ECoT-Lite-like by 3.7% on LIBERO-Plus and significantly outperforms baselines on unseen objects in real-world experiments. This demonstrates that TARA generalizes end-to-end/zero-shot. By training a planner on demonstrations for OOD tasks, we assess the generalization capabilities of the low-level policies in OOD scenarios, since our focus is not on improving high-level planning and reasoning. We will clarify this in the paper.
We will expand our real-world experiments to 5-6 tasks, each with 10 trials.
By tying the action horizon to subgoal completion, we improve the causal effect of reasoning on action generation. Steerable Policies [1] investigates adaptive selection of subgoal representations, while we improve steerability of individual representations via TARA. Do What You Say [3] approaches alignment using computationally expensive test-time verification to select among sampled action chunks, while we directly improve the conditional action distribution π(action∣observation,reasoning). Mixture of Horizons [2] fuses sampled fixed horizons to optimize the test-time trade-off between reactivity and compounding errors, while we train flow-matching policies on variable-length targets aligned with subgoals. We repurpose existing trajectory annotation strategies, such as directional end-effector motion in LaRA-VLA [4] or visual traces in ThinkAct [5], as segmentation heuristics such that any subsegment sampled during training does not contradict the annotation.
Given the identical (imperfect) planner, TARA outperforms ECoT-Lite-like on OOD-90, LIBERO-Plus, and real-world tasks (Figures 3 and 4, Table 1). We use PaliGemma as the planner, which might make mistakes. Nevertheless, TARA beats ECoT-Lite-like by 4.8% on OOD-90 and by 3.7% on LIBERO-Plus (end-to-end zero-shot). We aim to effectively leverage pretraining knowledge, generalizability, and reasoning capabilities of VLMs for embodied control; our goal is not to improve the reasoning or achieve a perfect planner. We include supplementary videos on OOD-90 that show TARA recovering from inaccurate subgoal predictions once the planner self-corrects, while ECoT-Lite-like does not (TARA: videos/tara_subgoal_recovery, videos/tara_subgoal_recovery_2; baseline: videos/baseline_subgoal_recovery, videos/baseline_subgoal_recovery_2).
We will run an experiment with corrupted segmentation.
[1] Steerable Vision-Language-Action Policies for Embodied Reasoning and Hierarchical Control. arXiv 2026
[2] Mixture of Horizons in Action Chunking. ICML 2026
[3] Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification. ICRA 2026
[4] Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models. ICML 2026
[5] ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning. NeurIPS 2025