- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
NEO-VLA embeds image patches directly into a shared vision-language backbone and gives a flow-matching action expert access to selected backbone layers. The paper studies how readout depth affects control, using policy comparisons, representation interventions, and spatial probes.
Critical strengths
-
Section 3.3 makes readout depth an explicit policy choice through the layer map. This is a useful abstraction: a backbone may contain information that its action expert cannot readily access. Figures 1 and 2 explain the interface clearly and connect the architectural design to the question investigated in the experiments.
-
Table 3 provides informative evidence within the native backbone. Frozen
skip-28achieves 90.9 average success versus 86.7 forend-28, with the same retained backbone depth and expert depth. The disjoint early/late maps reinforce the relevance of readout position. Section 5.2 also appropriately distinguishes the early-only configurations, which truncate the backbone, from the other comparisons. -
Figure 3 and Appendix B contain thoughtful controls. Scene replacement is compared with matched-magnitude noise, and the span analysis includes matched-random replacements. The wrist-frame policy is a particularly useful positive control: camera pose affects prediction when it defines the output coordinate frame. This makes the interpretation of the robot-frame policy's weak pose dependence more convincing.
-
Appendix E connects accessibility to a concrete property of the representations. Table 12 reports similar peak depth and correspondence scores across backbones, with larger differences at the layers available to the action expert. Together with the encoder-access Qwen result in Table 2, this suggests a useful design principle that extends beyond the proposed native backbone.
Critical weaknesses
-
The architectural conclusion in the abstract places more weight on encoder removal than Table 2 supports. Giving Qwen's expert intermediate encoder access raises its score from 79.5 to 90.3, close to frozen NEO-VLA's 90.9. Section 5.1 recognizes that the independently pretrained backbones differ in several respects. The clearest contribution is therefore the importance of accessible intermediate features; the scientific case for encoder removal itself is less developed. This distinction affects how I assess the novelty and scope of the work.
-
Sections 3.2 and 5.2 explain the benefit through early fine-grained geometry and later semantic processing. Appendix E supports the accessibility of spatial information, but does not directly connect the decoded quantities to the information responsible for the action improvements. Moreover, Figure 3's instruction–image–instruction pattern suggests intertwined visual and linguistic processing. The proposed hierarchy is a plausible interpretation, although the results more securely establish useful joint representations at particular depths than a specific progression from geometry to semantics.
-
The attachment-point analysis in Figure 3 identifies how a trained expert uses its inputs; its broader architectural implication is less direct. Weak sensitivity to a late attachment need not mean that the corresponding representation is intrinsically less useful for another readout. Table 3 also shows that adaptation changes the preferred configuration: early-only
first-28leads when frozen, while distributedskip-28leads after fine-tuning. The paper acknowledges this distinction, but its general statement that action prediction relies primarily on early representations should retain that qualification.
Questions for authors
- In light of Table 2, do the authors regard encoder removal or intermediate representation access as the principal contribution?
- Should Figure 3 be read primarily as an account of this expert's learned dependence, or as evidence for a general hierarchy of representations useful for control?