- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PearlVLA, a VLA framework that progressively refines latent action plans using feedback from a pretrained latent world model (LaWM). The method iteratively predicts future visual representations and uses them to update the latent plan before generating actions. The authors also introduce CRG-PRL to further optimize the refinement process through reward-based learning. Experiments are conducted on LIBERO, LIBERO-Plus, and RoboCasa using OpenVLA and GR00T N1.5 backbones.
Critical strengths
The paper is generally well written and easy to follow. The idea of using predicted future states to guide latent plan refinement is interesting, and the framework supports both regression-based and flow-matching action policies. The improvements on LIBERO-Plus, particularly under camera and robot-state perturbations, are also encouraging.
Critical weaknesses
My main concern is that the proposed framework introduces substantial complexity and computational overhead without demonstrating sufficiently significant improvements. The baseline comparisons are not convincing, as LIBERO is already a highly saturated benchmark, several competitive lightweight VLA models are missing, and the RoboCasa experiments mainly compare against older models rather than more recent alternatives. The method also heavily relies on a separately pretrained, benchmark-specific latent world model, raising serious concerns about its scalability and practicality in real-world settings. Furthermore, the improvements from progressive refinement itself are relatively marginal, and the additional RL stage provides almost no improvement despite introducing a complicated training pipeline. Overall, I do not find the current experimental evidence sufficient to justify the complexity or practical significance of the proposed approach.
Questions for authors
-
How do the authors justify the substantial additional complexity and inference overhead? The proposed method requires multiple world model queries before action generation, which significantly increases inference latency. Given the relatively small improvements, it is unclear whether this trade-off is practical for real-world VLA deployment.
-
Why are stronger and more recent baselines not included? LIBERO is already highly saturated, and competitive lightweight VLA methods such as VLA-Adapter are missing from the comparison. Similarly, the RoboCasa evaluation relies on GR00T N1.5 rather than more recent models such as N1.7. A stronger and more up-to-date comparison would be important to establish the significance of the proposed method.
-
How well does the proposed method generalize beyond the pretrained world model's data distribution? The approach relies on benchmark-specific LaWM checkpoints, but it is unclear whether such a relatively small latent world model can accurately predict action consequences in more diverse and challenging environments. How would the refinement process behave when the world model produces inaccurate predictions?
-
What is the actual benefit of iterative refinement and the additional RL stage? According to Table 4, progressive refinement only improves performance by 0.6 percentage points over the cached-LaWM baseline, while CRG-PRL further improves LIBERO and RoboCasa by only 0.2 and 0.3 points, respectively. These gains seem insufficient to justify the additional complexity, especially without stronger evidence on more challenging benchmarks or real-world manipulation tasks.