- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether VLA strategies must rely on reasoning text generated during the current inference process when executing actions. The proposed approach maintains supervision over the reasoning process but masks the current reasoning tokens when passing information to a flow-matching-based action execution module. During deployment, the system skips text generation for tasks that do not require memory; for tasks involving memory, it generates "ledger entries" alongside action execution, which are then provided to subsequent inference steps. The study evaluates TacitVLA against "Explicit Reasoning" and "No Reasoning" baselines using benchmarks such as RoboMME, RMBench, LIBERO/LIBERO-Plus, and PhysicalAI-AV. Results demonstrate that TacitVLA achieves overall performance comparable to "Explicit Reasoning" while reducing per-inference latency by up to 3.4 times.
Critical strengths
- The comparison between "Explicit Reasoning" and "Tacit VLA" employs identical training sequences, data, prompts, and loss function formulations; the sole distinction lies in whether the "action expert" has access to the current reasoning tokens. This approach is designed to investigate directly whether action generation must rely on previously generated reasoning content, rather than merely comparing two entirely disparate systems. The comparative analysis presented in Table 1 further reinforces this argument.
- A simple deployment strategy has enabled a significant reduction in latency. Latency per invocation decreased from 495 ms to 147 ms for LIBERO tasks, and from 220 ms to 127 ms for the RoboMME Counting task. This method achieves a tangible improvement in efficiency without requiring the sacrifice of essential textual memory.
Critical weaknesses
- Novelty is limited, and the additional empirical insights presented require more robust substantiation. As noted in Section 2, existing studies (e.g., ECoT-Lite, VLA-OS, and ZR-0) have already explored "reasoning-supervision-based strategies," which eliminate the text-generation phase during deployment. The authors distinguish their work from these predecessors through more rigorous experimental controls, an extension to memory-based tasks, and the inclusion of latency evaluations. While these contributions are valuable, the core advancement lies in the execution of controlled empirical studies and the proposal of deployment strategies, rather than the establishment of a fundamentally new principle for "decoupling reasoning from action." Consequently, the significance of this paper hinges largely on the new understanding derived from its experiments.
- Aggregated similarity metrics mask substantial differences in performance regarding robustness and safety. In the LIBERO-Plus benchmark (Table 12), TacitVLA achieves an overall success rate comparable to that of the "Explicit Reasoning" approach (72.9% versus 73.5%). However, when subjected to camera perturbations, TacitVLA’s performance drops by 9.3 percentage points (42.2% versus 51.5%), whereas it improves by 8.9 percentage points (60.0% versus 51.1%) when faced with sensor perturbations. Consequently, this aggregated similarity reflects, to some extent, a balancing of strengths and weaknesses rather than a robust retention of generalization capability.
- Based on comparisons involving memory tasks, it is not possible to isolate the representational gains specifically attributable to "reasoning supervision." Section 4.1 notes that the impact of the supervision path can be isolated by comparing TacitVLA against a "No Reasoning" version. However, Section 5 explicitly acknowledges that the "No Reasoning" version lacks both reasoning supervision and the "ledger" mechanism required for memory tasks; consequently, this comparison measures the combined benefits derived from both.
Questions for authors
- What new findings does this study offer that go beyond the existing conclusions in the literature discussed in Section 2?
- How can the discrepancy between the results for "Camera" and "Sensor" in Table 12 be explained? Furthermore, how robust are these findings when faced with changes in evaluation methodology or the inherent randomness of independent training processes?
- Which experimental results specifically isolate the impact of "reasoning supervision," and which ones measure its combined effect when paired with "ledger access"? Is there evidence to suggest that "reasoning supervision" provides independent benefits, even when memory inputs remain constant?
4 comments
(W2 + Q2) Camera and sensor axes on LIBERO-Plus
We agree that aggregate metrics can mask per-axis differences that matter for robustness and safety. We hope to clarify that our claim is that TacitVLA matches Explicit Reasoning at under a third of its latency (147 vs. 497 ms on LIBERO-Plus), so the question for each axis is whether TacitVLA matches. It matches within 1.4 points on five of seven axes, and the two exceptions point in opposite directions (differences computed from Table 12):
| Difference (points) | Robot init. | Sensor | Camera | Language | Objects | Background | Light | All |
|---|---|---|---|---|---|---|---|---|
| TacitVLA − Explicit Reasoning | −1.2 | +8.9 | −9.3 | −0.7 | −1.2 | +0.8 | −1.4 | −0.6 |
| TacitVLA − No Reasoning | +10.2 | +8.3 | +1.2 | +6.4 | +3.9 | +5.1 | +1.4 | +5.3 |
TacitVLA also scores above No Reasoning, which runs at the same latency, on all seven axes.
Camera and sensor are exactly the axes known to swing with changes to a policy's design. In the LIBERO-Plus evaluation ([1], Table 2), removing OpenVLA-OFT's wrist camera costs it 46.0 points on camera and 25.9 on sensor noise, and π0 and π0-FAST, which share a PaliGemma backbone, differ by 51.3 points on camera.
The paper's findings also hold under changes in evaluation methodology, and on RoboMME when each policy is retrained at other loss weights. Every per-axis result in Table 12 has a standard deviation of at most 1.1 points. The match holds on standard LIBERO (98.6 vs. 98.1) as it does under perturbations, and in both driving evaluations: open loop on held-out real recordings (minADE 1.116 vs. 1.140 m) and closed loop on out-of-distribution, simulator-rendered images (scene score 52.5 vs. 52.3). In Table 11, each policy is retrained at three cross-entropy weights in two RoboMME setups. TacitVLA exceeds No Reasoning in all six settings, ranks best among the three policies in five, and is within 1.2 points of Explicit Reasoning in the sixth.
The revised paper adds this per-axis analysis to Section 6.1 and qualifies the claim in the abstract and conclusion to overall success.
(W3 + Q3) Isolating reasoning supervision from ledger access
We agree that on memory tasks, TacitVLA against No Reasoning measures the combined benefit of reasoning supervision and ledger access, as Section 5 states. On the non-memory tasks, where no policy keeps a ledger, that comparison already isolates reasoning supervision (Section 4.1). On the memory tasks, the paper's central comparison holds ledger access constant: TacitVLA and Explicit Reasoning keep a ledger in the same way, and TacitVLA matches it (89.5 vs. 86.7 on RoboMME Counting, 77.5 vs. 77.0 on RMBench). We also trained a new control on RoboMME Counting under the same protocol as Table 2: TacitVLA's recipe with ledger access kept and only the supervision on the current reasoning text removed. We clarify that on these tasks, the reasoning text is the predicted next subtask, which becomes the next ledger entry, so a policy without this supervision never learns to write its own ledger. At test time, the simulator therefore supplies its memory inputs: the ground-truth subgoal at each replan, in the wording of the training labels. A deployed policy would not have these privileged subgoals, which is why the submission trained only deployable policies. As a diagnostic, however, the control tests whether ledger access with correct memory inputs can replace reasoning supervision.
Ledger access alone does not reproduce the gain, even with ground-truth memory inputs:
| Policy | Reasoning supervision | Ledger at test | Success (%) |
|---|---|---|---|
| No Reasoning | no | none | 79.0 ± 1.0 |
| Control | no | simulator's ground truth | 66.8 ± 12.2 |
| TacitVLA | yes | its own entries | 89.5 ± 1.3 |
TacitVLA, which writes its own ledger, scores 22.7 points above the control (89.5 vs. 66.8). We believe the control falls even below No Reasoning (66.8 vs. 79.0) because predicting the next subtask is what teaches the backbone to track progress from the ledger. Evidence that reasoning supervision has an independent benefit with memory inputs held constant comes from the ledger-free tasks, where it adds 5.3 points on LIBERO-Plus and 6.1 in closed-loop driving (Tables 5 and 6), and from the stop-gradient and text controls (W1), which also run without a ledger. We have added this control to Table 2 and Section 6.1 of the revised paper, and the revised Sections 4.1 and 5 state which comparisons isolate reasoning supervision.
Overall
The reviewer noted that the significance of the paper hinges on the new understanding derived from its experiments. We hope the findings above, now in the revised paper, provide it, and would be grateful if the reviewer would consider updating their assessment.
[1] Fei et al. LIBERO-Plus. CVPR 2026. https://arxiv.org/abs/2510.13626
Thank you for the detailed responses and additional experiments, which strengthen the empirical analysis and address some of my concerns. However, my concerns about the novelty beyond prior work, robustness across independent training runs, and the separation of reasoning supervision from ledger access remain only partially resolved. I will therefore maintain my original rating
We thank the reviewer for the follow-up and for noting that the new experiments strengthen the analysis. We address each of the three remaining points below.
Novelty beyond prior work. The prior works the reviewer lists leave open the question of whether a reasoning VLA must pay the latency of reasoning at deployment. ECoT-Lite [1] concludes that "full test-time reasoning has the best performance, as expected," which our controlled comparison contradicts. VLA-OS [2] and ZR-0 [3] point the opposite way and are conducted in settings that do not isolate the action's access to the reasoning. TacitVLA provides the missing comparison by changing only that access, showing that the action does not need to wait for the reasoning on all four benchmarks, spanning manipulation and driving, and achieving up to 3.4 times lower latency at no cost in overall success.
Robustness across independent training runs. To directly answer this, we independently trained each policy three times on RoboMME Counting with different seeds:
| Policy | Run 1 | Run 2 | Run 3 | Mean ± sd |
|---|---|---|---|---|
| No Reasoning | 79.0 | 78.5 | 79.5 | 79.0 ± 0.5 |
| Explicit Reasoning | 87.5 | 87.5 | 86.0 | 87.0 ± 0.9 |
| TacitVLA | 89.5 | 89.0 | 89.5 | 89.3 ± 0.3 |
Each policy varies by at most 1.5 points across runs, and the ordering of Table 2 in our paper holds in every run, particularly with TacitVLA matching Explicit Reasoning's performance and outperforming No Reasoning.
Separating reasoning supervision from ledger access. We agree that the separation should be studied, and our results do so directly. On RoboMME, the control keeps ledger access, removes only reasoning supervision, and even receives the simulator's ground-truth ledger entries while TacitVLA must write its own. Despite this advantage, the control trails TacitVLA by 22.7 points (66.8 vs. 89.5, Table 2 in our paper). On LIBERO-Plus and in closed-loop driving, where no policy keeps a ledger, reasoning supervision alone adds 5.3 and 6.1 points over No Reasoning (Tables 5 and 6 in our paper). Therefore, reasoning supervision brings a benefit of its own, both when ledger access favors the control and when no ledger is used at all.
[1] Chen et al. Training Strategies for Efficient Embodied Reasoning (ECoT-Lite). CoRL 2025. https://proceedings.mlr.press/v305/chen25a.html
[2] Gao et al. VLA-OS. NeurIPS 2025. https://arxiv.org/abs/2506.17561
[3] Li et al. ZR-0. arXiv 2026. https://arxiv.org/abs/2606.30552
We thank the reviewer for recognizing that our comparison changes only the action expert's access to the current reasoning, so it directly tests whether action generation must rely on the generated reasoning. We also thank the reviewer for noting that latency falls from 495 ms to 147 ms on LIBERO, and that the memory tasks keep their textual memory. We ran four new controls, summarized in the table under W1, and answer the camera and memory questions in our second comment (W2 and W3).
(W1 + Q1) New findings beyond ECoT-Lite, VLA-OS, and ZR-0
As the reviewer notes, the more rigorous controls, the extension to memory tasks, and the latency evaluation are valuable contributions. We agree that the significance of the paper hinges on the new understanding derived from its experiments. We hope to clarify that this understanding goes beyond, and in part revises, the existing conclusions in the literature discussed in Section 2.
On the central question of whether a policy whose action never conditions on the current reasoning can match one that does, prior work disagrees. In ECoT-Lite [1], the arms whose actions never attend to the reasoning (reasoning pre-training and co-training) trail full ECoT by 3.7 to 8.1 points (their Tables 1 and 2), though these arms also change the training mixture. Its authors conclude that "full test-time reasoning has the best performance, as expected". Because ECoT-Lite's reasoning dropout deploys without the text but trains the action to attend to the reasoning whenever it is kept, it does not test whether an action that never conditions on the reasoning can match one that does. In a different architecture, VLA-OS [2] finds that implicit planning beats explicit planning. There, separate planning heads rather than the backbone write the plan, and the policy is a 0.5B model trained from scratch, where explicit planning scores below the action-only baseline. An arXiv preprint from June 2026, ZR-0 [3], claims "without any performance loss" yet reports no experiment testing this: it includes no explicit-reasoning or matched no-reasoning policy, removes its entire pretraining stage in its only ablation, and drops reasoning supervision on its benchmarks.
We vary only the action expert's attention within one training sequence, on pretrained backbones of the architecture recent reasoning VLAs adopt. The masked policy matches a strong explicit-reasoning policy in overall success on all four benchmarks at up to 3.4 times lower latency. When only the attention changes, conditioning the action on the current reasoning is therefore not needed for overall success.
We also study a regime that none of these prior works considers: memory tasks, where the reasoning text must persist as a ledger. Because TacitVLA generates each entry during action execution, generating the ledger adds no latency (Section 6.2), and it maintains a correct ledger in 99.7% of Press Button episodes (Table 14).
Our new experiments add findings that none of these works tests:
These results show where the benefit of reasoning enters the action. Reasoning reaches the action through the representation it trains, so the action need neither wait for nor attend to the reasoning text, and on memory tasks, its generation can move off the action's critical path. The core finding holds across policies of 2.5B to 3.9B parameters built on pretrained backbones, three reasoning formats, and four benchmarks in two domains, with 50 demonstrations per task to 3.8 million real driving events. The evaluation includes closed-loop driving, in which policies trained on real recordings act on out-of-distribution, simulator-rendered images.
In the revised paper, Section 2 now states these distinctions explicitly, and Section 6.1 and Appendix B add the new findings.
[1] Chen et al. Training Strategies for Efficient Embodied Reasoning (ECoT-Lite). CoRL 2025. https://arxiv.org/abs/2505.08243
[2] Gao et al. VLA-OS. NeurIPS 2025. https://arxiv.org/abs/2506.17561
[3] Li et al. ZR-0. arXiv 2026. https://arxiv.org/abs/2606.30552