- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work presents a semantic latent-based WAM. In other words, the vision branch of WAM is trained in DINO/SigLIP/V-JEPA space instead of VAE space. Besides, empirical experiments show that learning efficiency is improved and that the intermediate layer is more meaningful than the final layer. Experiments further demonstrate that this design achieves comparable results.
Critical strengths
The method is simple and easy to follow, and the paper’s presentation is clear.
Critical weaknesses
My main concern is the effectiveness. SLAP only conducts comparison on LIBERO and robotwin, but both of them are lay behind SOTA method. The reason for this is not pretrained on robot data, which does not make sense.
There are some inconsistency in the paper presentation, like hide the results in LIBERO comparison table but claim in your abs .
Questions for authors
-
There are some baselines listed in the abstract, but why are only two listed in the teaser figure? Where is LingBot-VA in the figure? Is it also missing from Table 1?
-
It does not make sense to attribute SLAP’s underperformance relative to previous SOTAs to the lack of pretraining on robot data. Why was the model in this work not pretrained to make it comparable to the other baselines? The performance gap widens further on RoboTwin. Could the real-world experimental results be presented in a new quantitative table using success rates?
-
How should we understand the limitation mentioned in the introduction? As far as we know, the base model used in this work uses a VAE to encode pixels into high-level features and performs denoising and inference in latent space, not pixel space. Am I missing something? Even if you perform denoising in DINO space, do you still need to use flow-matching schedulers?
-
How are the frame-wise DINO/SigLIP/V-JEPA features aligned with the original temporally compressed VAE space?
-
Why not simply align with DINO/SigLIP/V-JEPA using a REPA-style approach [1]? In this scenario, the priors may be better exploited.
-
Could the predicted DINO/SigLIP/V-JEPA features be decoded into pixel space, as in RAE?
-
I think there may be a gap between the original Wan2.2 priors and the newly learned high-level feature space, which could lead to the degradation of the original Wan2.2 priors.
[1] REPRESENTATION ALIGNMENT FOR GENERATION: TRAINING DIFFUSION TRANSFORMERS IS EASIER THAN YOU THINK