- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This work presents DFA-VLA, an approach that replaces the 256-token dense visual prefix in OpenVLA with 5 sparse tokens. These tokens are selected via instruction-driven cosine retrieval and a learnable gate from a pool of original global tokens and MobileSAM-segmented local tokens. The paper investigates whether this 5-token prefix can serve as a viable substitute for the dense prefix in visually cluttered scenes. Simulation results (1,000 steps in LIBERO-Spatial, 32 paired scenes) indicate that it cannot. While real-world evaluations (22 tasks, 220 trials on two industrial robots, 10,000 training steps) show DFA-VLA achieving 78.6% versus public OpenVLA's 71.1%, the lack of proper matched controls renders these numbers incomparable.
Critical strengths
- The paper has a clear motivation and a straightforward approach. It reports its results honestly and offers some valuable insights.
Critical weaknesses
- The paper lacks comparisons with SOTA models. The baselines used here are somewhat outdated, leaving it unclear whether this method actually works on newer, more advanced architectures.
- The paper is poorly organized. Several key results and experiments are buried in the appendix; moving them to the main text would make the paper much more substantial and better support its claims.
- The simulation experiments are severely underpowered. They use 32 scenes and a single random seed, and the training loss clearly shows the model is underfitting, leading to poor performance. Because of this, the experiment ends up testing whether the sparse prefix underfits on a short training budget, rather than whether it can actually handle visual clutter.
Questions for authors
1, Although the approach saves on visual tokens, the added latency from MobileSAM is quite significant. How was this implemented in real-world physical evaluations, and are there more efficient alternatives? 2. What accounts for DFA-VLA's poor simulation performance contrasting with its superiority over OpenVLA in real-world tasks? Is there any supporting evidence from the training period? Can you provide a simulation baseline matched to the 10,000-step training budget?
Response to Reviewer iZvK
Modern models and organization. The new comparison controls the intervention within OpenVLA. It does not test compatibility with newer VLA architectures or establish state-of-the-art performance. The revised manuscript states this scope and presents the controlled success counts, full-policy timing and mechanism diagnostic in the main results. A comparison to an unmatched published score would not repair this evidence gap.
Budget and sample size. We completed the requested matched 10,000-step simulation baselines. All three trainings start from the same checkpoint, use the same seed and demonstrate identical input-order and per-step data-chain hashes. Their final outcomes remain 26/32 dense, 10/32 sparse-global and 11/32 DFA on the reconstructed paired plan. This addresses the longer-budget control, while retaining the single-seed/eight-block limitation. It does not address statistical power across independent training seeds or unseen tasks. We report small-subset fit diagnostics separately; they cannot substitute for closed-loop evaluation.
Physical/simulation discrepancy and MobileSAM. The physical and simulation evaluations differ in scoring. The two physical methods used the same CR5 demonstrations according to the author, but a fully matched comparison of their training schedules and controller settings has not been established. We have recovered UMI gripper-range and SLAM/tag calibration records, and the author confirms that the CR5 demonstrations were collected with a mounted UMI gripper. The author confirms that the CR5 demonstrations were used to train the DFA-VLA physical policy associated with the reported 78.6% score. The author also confirms that the OpenVLA physical comparison was fine-tuned using the same CR5 demonstrations. Shared demonstration data do not alone establish that training schedules and controller settings were matched. The exact checkpoint lineage, training schedule and complete robot-base mapping remain unverified. We therefore cannot attribute the physical/simulation discrepancy to the method. The new simulation evidence does not show an advantage for DFA over the dense baseline. The complete-policy timings reported here are simulation measurements. The available physical documentation does not establish the MobileSAM schedule or controller-loop latency. The same-A40 comparison directly measures the added cost of the simulation implementation. Alternative segmenters or scheduling strategies would require new measurements before any efficiency claim.
Supplementary diagnostic.
To test whether five tokens simply cannot fit the training examples, we ran three matched small-subset conditions: top-5, top-32 and five tokens with one forced local slot. All three fit the same 64 training frames by step 50 (100% teacher-forced action-token accuracy). On 64 frames from different demonstrations of the same four tasks, token accuracies were 23.0%, 37.1% and 21.7%; the unadapted dense reference achieved 88.6%. Increasing the prefix or forcing a local slot therefore did not establish generalization in this diagnostic. The forced slot produced nonzero local-position gradients, whereas top-5 and top-32 selected no local tokens in these training evaluations. These observations support reporting routing and generalization limitations; they do not establish a universal causal explanation or a closed-loop benefit from either change. We have not launched another 10,000-step training on this basis.
Initialization and inherited pretraining. All three matched simulation trainings start from the same public
openvla/openvla-7b-finetuned-libero-spatialcheckpoint (revision962318cec55ac10993ff0f5f43eda9a270b4c873) and uselibero_spatial_no_noopsfor the additional 10,000 steps. We directly load the released checkpoint; its upstream foundation pretraining and official LIBERO fine-tuning were not performed in this work. This initialization inherits OpenVLA real-robot pretraining, including BridgeData V2, and subsequent public LIBERO adaptation. The reported simulation comparison therefore concerns the prefix intervention and subsequent adaptation within this shared initialization, rather than training a VLA from simulation alone. Inherited BridgeData V2 pretraining is distinct from the previously stated, still-unverified additional 5,000-step BridgeData V2 stage for the physical policy.The author further confirms the physical training sequence: LIBERO adaptation followed by fine-tuning on the CR5 demonstrations collected with the mounted UMI gripper. Exact checkpoint identifiers and training step counts have not been independently recovered.