- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SparQ4D, a framework that enhances Vision-Language-Action (VLA) policies through sparse 4D query supervision. It unifies depth estimation, point motion prediction, multi-view correspondence, and hand-eye relations into a shared 3D coordinate prediction task. A lightweight query decoder extracts geometric information from intermediate VLA representations and is removed after training, introducing no additional inference overhead. Experiments on RoboTwin 2.0 and real-world manipulation tasks demonstrate consistent improvements over the original VLA backbones, alongside favorable computational efficiency compared with world action models.
Critical strengths
-
The proposed framework integrates multiple spatial and temporal supervision objectives through a shared query decoder, avoiding dense visual reconstruction. Removing the decoder after training preserves the original VLA inference architecture and computational requirements, providing a practical approach to improving geometric representations.
-
The method demonstrates substantial performance gains across two VLA backbones, RoboTwin simulation benchmarks, and real-world robotic manipulation tasks. The additional evaluation on 50 RoboTwin tasks further supports the effectiveness of the proposed supervision strategy across diverse manipulation scenarios.
Critical weaknesses
-
The ablation results in Table 6 indicate that individual geometric supervision objectives already recover a substantial portion of the overall performance improvement. Although combining all four query types achieves the best results, it remains unclear whether the unified 4D query formulation provides meaningful advantages over simpler alternatives, such as conventional depth regression or separate geometric prediction heads. Comparisons under matched supervision and computational budgets would better isolate the contribution of the proposed design.
-
The RoboTwin experiments use demonstrations from both Clean and Randomized settings, leaving the effectiveness of the learned geometric representations under genuinely unseen perturbations insufficiently examined. A more informative evaluation would train the baseline and SparQ4D exclusively on Clean demonstrations and evaluate them zero-shot under Randomized or Hard settings. This would help establish whether the benefits of 4D supervision extend beyond the training distribution.
-
The reported training and inference efficiency advantages over X-WAM and Fast-WAM involve substantially different backbone architectures and parameter scales. Consequently, the observed differences cannot be attributed solely to sparse query supervision. Furthermore, the accounting of offline preprocessing costs, including point tracking and geometric target generation, should be clarified to support a more comprehensive and fair comparison of computational efficiency.
Questions for authors
See weaknesses.