- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RoboSTG, an inference-time guidance framework that does not update policy parameters. The method uses a differentiable mapping to convert generated action sequences into predicted physical states, then scores the trajectories using spatial score fields and geometric relations between entities. The authors further introduce temporal weights and manipulation-stage-dependent objective weights, and inject gradients of the objective into action generation to guide the frozen policy toward satisfying task requirements. Using a frozen X-VLA policy, the paper describes paired evaluation settings on LIBERO-Object and RoboTwin, but provides insufficient quantitative results. It also reports experiments on two real-world UR5 manipulation tasks. Each method is evaluated over 30 trials per task, with the total number of successful trials increasing from 41/60 to 48/60.
Critical strengths
The method provides a unified interface for incorporating task geometry into a frozen generative policy. It integrates spatial proximity, relations between entities, and execution stages into a trajectory objective, and propagates the objective gradients back to the action sequence through a differentiable mapping. This allows task requirements to be expressed explicitly while accounting for temporal dependencies between actions, without retraining the base policy.
Critical weaknesses
- The experimental evidence is insufficient. The simulation section describes the setup but reports no quantitative experimental results. The real-robot evaluation covers only two tasks, with 30 trials per method per task, which limits the scope of validation. The baseline method used in the real-robot experiments is also not specified.
- The symbol ‖Δa‖_2 on the vertical axis of Figure 4 is not defined. Moreover, Figure 4 only shows how the guidance signals change over time. Without the key control comparisons, it cannot establish that this design improves performance.
Questions for authors
- Could you clarify what experiments were conducted on LIBERO-Object and RoboTwin and provide the quantitative results? How did RoboSTG compare with the pretrained policy in terms of task success rate and mean executed actions?
- Which pretrained policy checkpoint is used in the real-robot experiments, and how are the object states and task geometry required for guidance obtained?
- What does Δa in Figure 4 represent, and how is its norm computed? Could you provide ablations using only spatial guidance, only relational guidance, and fixed objective weights to establish the contribution of each design?
Please take a moment to respond the authors. Thank you!