- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
FreshVLA learns continuous latent actions from video using motion-guided attention, a coarse-to-fine temporal hierarchy, and frequency-domain regularization. The pretrained encoder is then frozen, and a downstream policy jointly generates latent and robot actions. The method achieves strong results on LIBERO, CALVIN, LIBERO, and real-world manipulation tasks. The paper also examines action decodability, frequency structure, and robustness to visual perturbations.
Critical strengths
-
The temporal hierarchy improves control performance within the continuous representation. The comparison in Figure 4 raises average LIBERO success from 96.0% to 98.2%, with a larger gain on LIBERO-Long, from 93.0% to 98.0%. The CALVIN and real-world results provide further evidence that the approach is practically useful.
-
The representation analyses complement the policy results. The action-regression, frequency-probing, and appearance-perturbation experiments help examine what the latent actions retain. These analyses provide more insight than benchmark success rates alone.
Critical weaknesses
-
The gains from the representation and the downstream framework are not sufficiently separated. VILLA-X[1] and ALAM[3] already jointly generate latent and robot actions, while JALA[2] demonstrates the importance of how latent representations are aligned with and incorporated into a policy. FreshVLA combines its representation with joint flow matching, but the current experiments do not establish how much of the improvement comes from this coupling rather than the proposed frequency hierarchy. Removing latent actions changes both factors at once.
-
The frequency regularizer lacks a direct ablation. Setting the decay coefficient to zero retains the frequency loss with uniform weighting. The 98.1% versus 98.2% comparison therefore does not establish whether frequency regularization itself is useful. A hierarchical model trained without is needed to distinguish the architectural contribution from the loss.
-
The VQ comparison needs tighter controls before supporting a general conclusion about continuous representations. Figure 4 already compares discrete/continuous and flat/hierarchical variants, which is useful. However, the manuscript does not sufficiently document codebook size, latent capacity, quantization settings, or codebook utilization. The large degradation of the hierarchical discrete model could reflect the particular VQ configuration or its optimization, rather than a limitation of discrete representations.
-
The external comparisons leave the advantage over recent latent-action methods unclear. JALA is cited but not compared experimentally, and the robustness analysis mainly uses LAPA and UniVLA. The paper should clarify its differences from recent alignment-based approaches and specify the camera configurations, pretraining data, and result sources behind the main comparison table. These details matter when interpreting the reported margins.
References
[1]. Chen, X., Wei, H., Zhang, P., Zhang, C., Wang, K., Guo, Y., Yang, R., Wang, Y., Xiao, X., Zhao, L., Chen, J., & Bian, J. (2026). villa-X: Enhancing latent action modeling in vision-language-action models. In The Fourteenth International Conference on Learning Representations.
[2]. Luo, H., Wang, Y., Zhang, W., Yuan, H., Feng, Y., Xu, H., Zheng, S., & Lu, Z. (2026). Joint-aligned latent action: Towards scalable VLA pretraining in the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 35047–35058).
[3]. Tang, Z., Liu, H., Chang, X., Wu, C., Huo, D., Yang, Y., Liu, B., Cai, Z., Xiong, F., Xu, M., Luo, J., Ma, D., Ma, Z., & Pan, G. (2026). ALAM: Algebraically consistent latent action model for vision-language-action models [Preprint]. arXiv.
Questions for authors
- Can you separate representation quality from policy integration by holding the latent encoder fixed while comparing joint denoising against an alternative use of the same latent targets, and holding the joint-denoising framework fixed while comparing latent representations?
- What is the performance of the hierarchical continuous model with removed entirely?
- Are the VQ and continuous variants matched in latent dimensionality, temporal context, encoder/decoder capacity, data, and training budget? Please report the VQ configuration and codebook utilization, and clarify whether the conclusion holds beyond a single codebook setting.
- Please specify the observation configurations and result sources for the main baselines, together with the CALVIN and LIBERO pretraining/evaluation splits.
Thank you for the additional experiments, which address my concerns about contribution attribution and frequency regularization. The VQ comparison remains limited to a single codebook configuration, and the baselines’ downstream observation settings and pretraining data still need clarification. At a minimum, the revised related work should discuss the methods mentioned in my review, including VILLA-X, JALA, and ALAM, and explicitly compare their latent representations and policy integration strategies with FreshVLA. Given the substantial progress in addressing my concerns, I raise my rating from 2 to 3.