- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents KAVA to address insufficient preservation of fine-grained visual information and limited reliability monitoring in JEPA-based latent world models. KAVA combines JEPA-loss gradients and action-perturbation sensitivity to select keyframes for sparse reconstruction supervision, with reconstruction gradients updating the encoder and decoder but not directly the dynamics predictor. It also introduces cSSIM, which measures the consistency of decoded images under small latent perturbations to filter unstable candidate rollouts during planning. Experiments on four visual control benchmarks show a 4.75% improvement in average success rate over LeWM, supported by rollout-filtering ablations, hyperparameter sensitivity experiments, and representation analyses.
Critical strengths
1、KAVA presents a coherent framework that uses a shared decoder for selective visual supervision during training and rollout stability screening during planning.
2、Experiments across four visual control benchmarks demonstrate improved average performance over LeWM, while ablations consistently support the contribution of rollout screening.
Critical weaknesses
1、Insufficient validation of keyframe selection. Without comparisons against random or uniform selection under the same reconstruction budget, the benefits of the proposed selection strategy remain unclear.
2、Limited validation of cSSIM as a reliability indicator. cSSIM measures local decoder stability, but its relationship with actual prediction errors is not evaluated. Improved planning performance alone does not establish reliable detection of erroneous rollouts.
Questions for authors
1、How does KAVA’s keyframe selection compare with random or uniform selection under the same reconstruction ratio and training budget?
2、Does cSSIM correlate with actual rollout prediction errors? Could you provide quantitative evidence of its ability to detect erroneous trajectories?