- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes EvoScene-VLA, a recurrent scene representation framework for chunked vision-language-action (VLA) policies. Built upon LingBot-VLA, the method jointly generates action chunks and future scene states through flow matching. The final predicted scene state is propagated to the next control chunk as a prior, where it is fused with new visual observations. During training, geometric supervision and a separate Scene Predictor provide learning signals for the scene representations, while these auxiliary modules are removed at inference.
The method is evaluated on RoboTwin, LIBERO, and three real-world cleaning tasks using Galaxea R1-Lite. Compared with a matched LingBot-VLA baseline, it improves average success rates by 2.4 and 2.2 percentage points on RoboTwin under Clean and Rand settings, respectively, by 2.7 points on LIBERO, and from 37.3% to 42.0% on real-robot tasks.
The central contribution is the integration of action-conditioned future scene prediction, cross-chunk state propagation, and observation-based correction within a unified VLA architecture.
Critical strengths
S1. Meaningful formulation and reasonably controlled evaluation.
The paper addresses a relevant limitation of chunked VLA policies: scene representations may become outdated as robot actions change the environment. Integrating future scene prediction and recurrent state propagation into the action decoder is an interesting design.
The experimental evaluation includes a matched LingBot-VLA* baseline with the same backbone, action chunk length, sampling schedule, and training protocol. The RoboTwin results include three independent training seeds, with 100 rollouts per task, setting, and seed. The improvements are observed across multiple tasks rather than being restricted to a few selected examples. The inclusion of real-robot experiments further strengthens the empirical evaluation.
S2. Useful ablations investigating recurrent scene representations.
The paper provides more than standard performance comparisons. Table 6 shows that introducing recurrence without appropriate scene supervision can reduce performance, while recurrence becomes beneficial when combined with scene supervision. Table 3 additionally investigates the effect of matched versus mismatched scene priors during closed-loop execution.
These experiments provide useful evidence that the recurrent representation carries information relevant to control, although they do not fully establish the necessity of the proposed mechanism.
Critical weaknesses
W1. The necessity and independent contribution of the proposed recurrent scene mechanism remain insufficiently established.
The paper argues that conventional temporal memories may become outdated after robot actions and proposes action-conditioned scene prediction to address this problem. However, existing VLA approaches already incorporate temporal memory, future-state prediction, or world-model representations. The paper does not sufficiently establish why the proposed action-updated recurrent state is necessary compared with simpler alternatives.
For example, an informative comparison would be to retain the previous corrected scene state across chunks without explicitly predicting future scene states, or to use an equally sized historical-memory representation. Although the paper discusses MemoryVLA, CUT3R, FLARE, UP-VLA, and other related methods, it lacks direct mechanism-level comparisons under matched conditions.
Furthermore, the ablations do not fully disentangle the contributions of geometric supervision, future-scene supervision, and joint action–scene generation. In Table 6, the future-prediction and representation losses are grouped together. It therefore remains unclear whether the improvements primarily arise from better auxiliary representation learning or from the proposed action-conditioned scene generation and propagation mechanism.
This limitation directly affects the assessment of the paper's central contribution, because the experiments establish the effectiveness of the complete system more convincingly than the necessity of its individual design choices.
W2. The claimed dynamic scene correction mechanism lacks direct experimental validation.
A central motivation is that the model should maintain an evolving scene state and correct inaccurate predictions using new observations. However, the experiments do not directly evaluate the accuracy of future scene predictions or the model's ability to correct incorrect priors when actual scene evolution differs from the predicted evolution.
Table 3 demonstrates that matched scene priors improve closed-loop performance compared with mismatched priors. Nevertheless, demonstrating that prior information affects action generation is not equivalent to demonstrating reliable scene-state correction. In particular, the camera-view replacement experiments introduce severe observation inconsistencies and do not directly establish robustness to natural occlusions, unexpected object movements, or execution disturbances.
An additional concern is the difference between training and deployment. During training, recurrent priors for subsequent chunks are supplied by the Scene Predictor using demonstration actions, while during inference they are generated by the action expert itself. The paper does not sufficiently clarify whether the same normalization is applied to these priors or investigate the consequences of possible prediction-distribution differences over repeated chunks. This is a potential source of error accumulation rather than an established implementation error.
Without direct measurements of prediction accuracy, correction accuracy, and recovery under scene changes, the evidence for the complete recurrent prediction-and-correction loop remains incomplete.
Questions for authors
-
Necessity of action-conditioned recurrence: How does the proposed mechanism compare with simply propagating the previous corrected scene state, or maintaining an equally sized historical-memory representation? These comparisons would help establish whether explicitly predicting future scene states provides an independent benefit.
-
Relationship to existing world-model approaches: Can the authors clarify the specific advantages of the proposed mechanism over relevant action-conditioned future-prediction and world-model approaches, such as FLARE, UP-VLA, and Motus? The published Motus results in Table 1 use a different training task set and therefore do not constitute a controlled comparison.
-
Contribution of joint scene generation: If all geometric and future-scene supervision is retained, but action tokens are prevented from attending to predicted future scene tokens, how does performance change?
-
Dynamic scene correction and training–inference consistency: How accurately do predicted scene states reflect actual future observations? Under unexpected object movement, execution disturbances, or incorrect priors, can the authors quantify prediction errors, correction accuracy, and recovery performance? Additionally, are recurrent priors normalized consistently during training and inference, and does training with action-expert-generated priors affect long-horizon stability?
-
Reliability of the reported improvements: Can the authors provide multi-seed uncertainty for the LIBERO component ablations and uncertainty estimates for the real-robot performance differences between methods? The reported Wilson intervals quantify individual success rates but do not directly characterize the uncertainty of the observed improvements.
Dear Reviewer YTTt,
Thank you once again for taking the time to review our paper and for your constructive feedback.
We sincerely hope that the additional experiments and our response have addressed your concerns.
If you have any further questions or suggestions, we would be glad to offer further clarifications.
Thank you for your time and consideration!