- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
BrainVLA encodes preparatory neural activity into intent representations and combines them with visual and language inputs for VLA action generation. A neural encoder is first trained using keypoint and target directions, followed by VLA adaptation with action and spatial losses. Experiments use MC Maze macaque recordings and corresponding physical-robot scenes. The method achieves 80.2% success on 96 unseen-condition trials, a 17.7-percentage-point improvement over π0.
Critical strengths
Combining neural intent decoding with a visual action model is a worthwhile research direction. The paper evaluates the resulting system on a physical robot rather than only reporting offline decoding accuracy. Improvements over π0 in obstacle and distractor settings are also consistent with the motivation for providing path information.
The target-matched shuffle in Appendix D is particularly informative. Exchanging neural signals between trials with the same target but different layouts substantially increases keypoint error, indicating information beyond target direction. The paper also includes shuffled-intent, text-representation, and ground-truth-direction controls, and reports success counts and confidence intervals for the robot experiments.
Critical weaknesses
The experiments do not yet establish the advantage of the proposed latent intent representation over a simpler neural interface. The π0 comparison shows that additional neural information helps. However, writing decoded directions as text changes both the information supplied and its numerical encoding, while the ground-truth-direction control eliminates decoding error. Feeding continuously projected Stage-1 direction predictions into the same VLA would provide a more direct comparison and help distinguish representation gains from interface effects.
The model-selection procedure for the generalization evaluation needs clarification. Appendix C states that training uses 54 conditions, whereas validation and test trials are sampled from all 108 conditions. Validation is used to select the neural encoder and neural decoding baselines. It is therefore necessary to establish whether the conditions described as unseen have already influenced model selection. Moreover, robot execution driven by recorded neural signals does not establish improvements in online neural closed-loop control or cognitive load.
There is an explicit inconsistency in the spatial-loss ablation. Section 4.3 reports 58.1% and 43.8% success on single- and multi-goal obstacle trials, pooled at 50.8%. Appendix Table 6 reports 54.8%, 34.4%, and 44.4% for the same ablation. The main-text values are identical to those of the text-representation ablation and should be checked.
Finally, the Wilson intervals in Table 5 quantify each model's success rate, not uncertainty in the model differences. Since the principal comparison uses the same 96 trials, a paired analysis would better characterize the improvement over π0.
Questions for authors
- Has a continuous projection of Stage-1 predicted directions been compared with the six intent tokens under the same VLA training budget?
- Did unseen-condition validation labels influence encoder or baseline selection? Please specify the selection criterion and recording-session split.
- What are the correct success counts for the no-spatial-loss ablation? Please also report a paired confidence interval for the BrainVLA–π0 success-rate difference.