- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Building on LaWAM, this paper organizes the policy backbone, latent world decoder, and action expert into a modular system with explicit interfaces. It also separates components used during training from those required for deployment. The authors compare Qwen3-VL-2B with Qwen3.5-0.8B on the same 2,000 LIBERO evaluation episodes, achieving success rates of 98.00% and 97.45%, respectively, while reporting a 42.4% reduction in deployment parameters. The paper also provides checkpoint tensor consistency checks and forward and backward execution tests with MiniCPM-V.
Critical strengths
- The compact backbone study provides useful evidence on the trade-off between success rate and model size. Table 2 compares the two checkpoints on paired episodes with identical tasks and initial states. The 0.8B configuration loses only 0.55 percentage points in success rate.
- The deployment export includes concrete checks and provides useful implementation guidance. Section 4.5 documents the removal of modules used only during training, the removal of duplicate parameter aliases, bitwise consistency checks on 1,078 retained tensors, and a CPU loader test. Section 3.6 also distinguishes interface compatibility, closed-loop performance retention, and transfer across backbones with a frozen world decoder.
Critical weaknesses
- The compact-backbone study has limited coverage and lacks comparisons with existing compact policies. The controlled closed-loop comparison covers only two Qwen backbone configurations on LIBERO. This provides limited evidence on whether the framework consistently preserves policy performance when the backbone is reduced. Comparisons with existing compact policies are also missing. For example, X-VLA [1] reports a model size of 0.9B and an average LIBERO success rate of 98.1%.
- The value of modularity across model families lacks closed-loop validation. The MiniCPM-V forward and backward smoke test checks interface compatibility, dimension alignment, and gradient propagation. These checks do not establish whether effective robot control can be maintained after replacing the backbone. A closed-loop evaluation with at least one backbone outside the Qwen family would provide stronger support for the practical value of the modular design across model families.
- The parameter reduction is not linked to measured training and deployment benefits. The paper reports parameter counts and training steps, but does not provide comparable training times or GPU-hours. It also lacks measurements of end-to-end inference latency and peak GPU memory usage during deployment.
[1] Zheng, Jinliang, et al. "X-vla: Soft-prompted transformer as scalable cross-embodiment vision-language-action model." International Conference on Learning Representations. Vol. 2026. 2026.
Questions for authors
- The compact-backbone comparison currently covers only two Qwen configurations on LIBERO. Could the authors extend the evaluation to other model families and additional benchmarks to assess whether the observed performance retention generalizes across models and task distributions?
- The MiniCPM-V smoke test shows that the adapter can execute, but does not assess control performance. Could the authors provide closed-loop LIBERO results for this backbone to evaluate the practical value of the interface across model families?
- Table 1 reports RoboTwin success rates of 92.09% on Clean and 89.12% on Randomized for AcrossWAM1.0. However, Section 4.2 excludes inherited LaWAM results and preliminary language diagnostics from these columns, while Section 5 states that the closed-loop evidence covers only LIBERO. Please clarify the source, model configuration, and evaluation protocol for these two results, and explain the inconsistency with the text.