- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces Continuous Reasoning, which aims to learn continuous intermediate representations of VLA models through action supervision alone, without requiring explicit reasoning annotations. The core method involves having a student model generate latent thoughts and requiring an EMA consumer to also utilize these representations for the same action prediction, thereby reducing generator-decoder co-adaptation. The approach further incorporates a Gaussian latent bottleneck with block-causal action decoding. Experiments demonstrate that CR achieves consistent improvements on LIBERO-PRO under position/task perturbations, ablation studies, and two real-world robotic tasks.
Critical strengths
- The problem is clearly defined, and the method design is concise. The paper directly uses action supervision to learn intermediate representations, avoiding reliance on additional reasoning annotations; the EMA consumer also provides a simple and targeted mechanism to alleviate the co-adaptation issue between the latent and its own decoder.
- The experimental results show good consistency. The improvement in CR is primarily observed under position and task perturbations, and the corresponding ablation studies mainly focus on these two settings. Moreover, similar trends are observed in real robot experiments, making the core conclusions more convincing than mere overall performance gains.
Critical weaknesses
- It has not yet been sufficiently demonstrated that the EMA consumer itself is essential, rather than a general auxiliary regularization effect. Current comparisons mainly involve removing verification or freezing the EMA consumer, but lack simpler controls such as an additional action head, or standard EMA consistency. Therefore, it remains difficult to determine whether the performance gain stems from the proposed moving-reader mechanism or simply from additional training constraints.
- Some experiments fail to cleanly isolate the contributions of individual CR components. For example, removing continuous thoughts also eliminates latent structuring and verification; removing Gaussian latent space simultaneously removes the bottleneck and WAE regularization. As a result, current ablation studies better demonstrate that the full design is effective, but make it harder to confirm whether each core component is individually necessary.
Questions for authors
- What is the inference computational overhead of CR compared to the original π0.5?
Although the EMA consumer is used only during training, CR still requires sequential generation of continuous thoughts at inference time. It is recommended to report latency, FLOPs, or actual control frequency to evaluate the deployment cost associated with performance gains. - Can CR be validated on another VLA backbone?
The current main results are based on π0.5. If similar improvements can be reproduced on different VLA backbones, it would more strongly support that CR is a general reasoning/representation learning mechanism rather than one dependent on specific backbone design.