- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper asks how structured intermediate states can become useful for robot control when an action decoder can bypass them. SCULPT-VLA learns task-progression, scene-dynamics, and spatial-grounding factors from frozen teachers. A three-stage curriculum first aligns the factors, then trains coarse actions through them while restricting direct perceptual access. It finally restores perception for continuous control. The main strength is this explicit transition from learning the factors to using them. Deployment requires neither the teachers nor autoregressive discrete-action decoding. However, exact training schedules and the semantic accuracy of generated annotations remain insufficiently documented. The overall performance is ok. On SimplerEnv-WidowX, success reaches 83.5%, compared with 71.3% when direct perceptual access remains available during the middle stage. Evaluation also covers LIBERO, RoboTwin, and real robots. The results support the staged design, although reproducing it requires more complete implementation details.
Critical strengths
• A direct test of the central idea. The perceptual-access ablation shows that the middle-stage restriction improves final control even after perceptual access is restored.
• Strong representation controls. Generic-pool and shared-computation variants test the organized factors beyond removing supervision. The generic-pool control matches teacher targets, token count, and training schedule.
• Broad and complementary evaluation. Multiple simulation settings and physical robots test practical value. Open-loop action agreement and closed-loop success provide consistent supporting evidence. The evaluation scope is ok.
Critical weaknesses
-
Key training settings are missing. Actual scaffold-annealing steps, numerical loss schedules, LoRA rank, and target modules are unspecified. These settings are important for reproducing the curriculum. It is the most important thing that I concern.
-
Annotation accuracy remains unquantified. A manual audit was performed, but human-verified instruction and boundary error rates are not reported. Parsing success and model confidence do not establish semantic correctness.
-
Derived data counts are incomplete. The exact Bridge release and retained segment totals are unclear. Source trajectory counts alone cannot reconstruct the data after segmentation and filtering.
Questions for authors
I still have three questions:
-
What are the exact annealing schedule, loss weights, LoRA rank, and target modules?
-
What instruction and boundary error rates were found in the existing manual audit?
-
Which Bridge release was used, and how many segments remained in each derived dataset?