- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how proprioceptive state should be represented and integrated into vision-language-action models. Using a shared \pi_{0.5} scaffold, the authors compare five state interfaces and investigate the effects of current-state conditioning, state-history length, and injection into the VLM versus the action expert. Experiments cover 45 atomic tasks and 20 composite tasks in RoboCasa365. The main finding is an interaction between interface choice and history length: on composite tasks, the VLM-prefix interface performs better with a single state frame, while the action-prefix interface performs better with a short state history.
Critical strengths
-
The paper addresses an important foundational question. Proprioception is widely used in robot policies, yet its representation, temporal context, and integration with pretrained VLMs are often treated as implementation choices. Investigating these decisions directly is valuable for understanding and designing VLAs.
-
The experimental framework enables more informative comparisons than comparisons across unrelated models. The interfaces share a backbone, visual inputs, action representation, and evaluation protocol. Reporting results separately across task families also reveals trade-offs that would be obscured by a single aggregate score. The principal comparisons include multiple independent training seeds.
-
The interface–history interaction is interesting, and the repeat-current control strengthens the evidence. The improvement from AP1 to AP8, together with the limited change from VP1 to VP8, suggests that temporal context and interface choice should be considered jointly. Training a slot-matched repeat-current baseline is a useful step toward distinguishing the benefit of temporal information from the effect of increasing the number of conditioning tokens.
Critical weaknesses
-
I appreciate the focus on a fundamental and practically important question. However, prior work such as ThinkProprio, which the paper cites, already includes controlled comparisons of proprioceptive encoding and entry points. The authors should more explicitly distinguish their findings from these existing studies. The main incremental contribution appears to be the interaction between state history and the conditioning interface, supported by the history-length sweep and repeat-current control. While this interaction is interesting, its validation remains concentrated in one scaffold and one simulation benchmark. I am therefore not yet convinced that the current evidence establishes sufficiently general design principles beyond a useful empirical comparison within the evaluated configuration.
-
The central interface–history interaction needs a deeper explanation. The most compelling result is that adding eight-frame state history improves AP from 28.6% to 38.7%, whereas VP remains essentially unchanged at 34.1% versus 34.0%. However, the paper does not sufficiently explain why the same numerical history benefits the action-side interface but not the VLM-side interface. It does not identify which temporal information is useful or why the interfaces exploit it differently.
-
The atomic K=8 values combine three-seed K=1 means with single-checkpoint history increments, rather than reporting directly measured multi-seed endpoints. Although this construction is disclosed, presenting these values alongside directly measured means makes the comparison harder to interpret.
Questions for authors
see weaknesses
5 comments
Regarding Q2 and Q3
Q2: Interface-history interaction
**Response to Q2.**Thank you for highlighting this interaction. The EEF-pose result alone does not imply that history is ineffective for VP. In the joint-angle setting, VP improves from 33.9% to 35.5% with eight-frame history (+1.6 pp; Table~2). Consistent gains appear on LIBERO-Plus (82.3%$\rightarrow$84.7%, +2.38 pp), the real robot (60.0%$\rightarrow$72.0%), and the atomic depth sweep, which also shows a positive short-window effect.
Our probes provide a possible explanation for the route difference. VLM-side history changes the shared multimodal prefix, with attention redistribution increasing from 17.3% for VP1 to 22.0% for VP8, whereas action-side history directly conditions the action expert throughout denoising and increases state-conditioned correction alignment from 0.079 to 0.270 (task-bootstrap 95% interval for the increase: [+0.143, +0.239]). Although these probes do not isolate a single sufficient temporal statistic, they suggest that ordered recent kinematic changes are more directly usable on the action side.
Changes in the manuscript: We added the overall VP1--VP8 task-bootstrap check and clarified the route-level probe interpretation in Sec. 5.2.3 (L390--431) and Appendix F.2.
Q3: Derived atomic values
Response to Q3. We agree that the derived atomic values should be visually separated from directly measured means. In the revised Figure 4, they are now drawn as hatched bars and labeled as derived values ( three-seed mean plus single-checkpoint increment), and the routing conclusion continues to rest on the directly measured composite endpoints (Table 2).
Changes in the manuscript: We revised the Figure 4 caption and Appendix F.1 to label atomic values as derived and to base the routing conclusion on directly measured composite endpoints.
We thank you again for the constructive feedback. We hope our revisions address the concerns, and we welcome any further questions or comments during the discussion.
Thank you for the additional experiments and clarifications. I appreciate the expanded evaluation on LIBERO-Plus and the real robot. However, my main concern regarding the scientific contribution remains. In particular, the LIBERO-Plus results show nearly identical history gains for AP and VP, with an interaction effect of only 0.40 pp. Thus, while the benefit of history transfers, the central claim that the preferred injection location changes with history length is not convincingly validated on this independent benchmark. The real-robot results are encouraging, but the comparison between VP and AP is still affected by differences in their native widths and computation paths. The proposed width-controlled experiment also remains incomplete. Overall, I appreciate the substantial additional effort, but I still view the contribution primarily as a useful empirical comparison rather than a sufficiently established general design principle.
Regarding Q1
We are grateful to you for the insightful and constructive feedback. In response, we have carefully considered each comment, conducted additional experiments, and revised the manuscript accordingly. We would be pleased to discuss these revisions in greater detail with you.
Q1: Broader transfer beyond the original scaffold
Response to Q1. Thank you for this valuable comment, which has been very helpful in improving the quality of our paper. We now clarify our relation to ThinkProprio in Related Work (L108--111). Beyond RoboCasa365, we added two complementary evaluations: LIBERO-Plus (L353--356, Table 3) and a real-robot study (Sec. 5.3, L449--466, Table 4). Both show that short history improves control: on LIBERO-Plus by +2.78 pp for AP and +2.38 pp for VP, and on the real robot from 59.0% to 79.0% for AP and from 60.0% to 72.0% for VP.
Additional results (paper Table 3): LIBERO-Plus success rate (percent)
\text{Policy} & \text{Spatial} & \text{Object} & \text{Goal} & \text{Long} & \text{Average} \\\\ \hline \text{AP1} & 85.3 & 84.9 & 77.4 & 76.3 & 81.0 \\\\ \text{AP8} & 90.0 & 88.2 & 79.2 & 77.6 & 83.8 \\\\ \text{VP1} & 87.2 & 85.8 & 79.5 & 76.8 & 82.3 \\\\ \text{VP8} & 88.6 & 91.4 & 81.8 & 77.1 & 84.7 \end{array}$$ **Additional results (paper Table 4): real-robot success rate (percent)** $$\begin{array}{lrrrrrr} \text{Configuration} & \text{Medication sorting} & \text{Handover} & \text{Can Spot} & \text{Bowls} & \text{Barcode} & \text{Average} \\\\ \hline \text{NS} & 30 & 70 & 100 & 70 & 10 & 56.0 \\\\ \text{SP1} & 20 & 70 & 100 & 80 & 10 & 56.0 (+0.0) \\\\ \text{AP1} & 35 & 80 & 100 & 60 & 20 & 59.0 (+3.0) \\\\ \text{AP8} & 75 & 80 & 100 & 100 & 40 & 79.0 (+23.0) \\\\ \text{VP1} & 50 & 60 & 100 & 80 & 10 & 60.0 (+4.0) \\\\ \text{VP8} & 60 & 80 & 100 & 80 & 40 & 72.0 (+16.0) \end{array}$$ **Changes in the manuscript:** We clarified the distinction from ThinkProprio in Related Work (L108--111) and added the LIBERO-Plus and real-robot evaluations in Table 3 (L353--356) and Sec. 5.3/Table 4 (L449--466).