- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This submission studies Human Execution Preference Transfer (HEPT), where human demonstrations define an execution prior, which is supposed to help held-out tasks by remaining informative. Authors formulate such study from three perspectives: source sufficiency, coordinate meaning, and realization. Based on these, a pipeline with frozen VLAs is implemented, and demonstrated to improve a few metrics.
However, this submission is still very early stage, most of the content is hard to understand. It is very likely to be AI written.
Critical strengths
None
Critical weaknesses
-
This submission is very unclear. It's hard to understand the key problem, the motivation, and the proposed method. Most description in the submission is generic. It is very likely that this submission was AI generated without real experiments conducted.
-
Most figures are ambiguous and look like to be AI generated too.
-
The proposed method seems to be just a pipeline. It's hard to understand the key technical contribution.
-
Experiments are incomplete and limited, hard to assess how the experiment results support the claims about the proposed pipeline.
Questions for authors
-
What is the key research question/research problem you are trying to address?
-
What are the metrics in the abstract, e.g., .4804 [0.1649, 0.8328] at L044?
-
Section 3, what's the meaning of each symbol, beyond just listing the name? Can you give some concrete examples?
-
Section 5, why these four research questions are pursued?
2 comments
After reading the rebuttal, it's clear that this submission was largely AI generated. All concerns raised in my original assessment still remain valid.
What HEPT Changes and How We Verify It
Thank you for pointing out where the technical contribution and the experimental evidence were hard to connect. HEPT asks whether human demonstrations can guide how a robot executes a skill it already knows, without copying the human trajectory or retraining the task policy. The contribution is to express the demonstration and the robot's response in the same measurable coordinates, TCP speed and jerk, and then test whether using the correct source changes the robot's behavior. At each saved simulation state, we hold the SmolVLA policy and scoring target fixed and compare the actions selected by the matched and swapped source mappings. Across 20 physical groups, matching rather than swapping improved local utility by 0.6202 (95% CI [0.0889, 1.1880]). All matched selections met the local task constraints.
A concrete example of Eq. 3. From the same saved peg-insertion state (h), one run executes the original action chunk and the other executes a bounded modification (delta = scale_neg). The demonstration-derived target z_s points toward lower speed and lower jerk. Relative to the original action, the measured response Delta b, divided by the fixed scales sigma, is -1.340 for speed and +2.139 for jerk reduction. The dot product with z_s gives +1.743, with unchanged endpoint error. The abstract's 0.4804 [0.1649, 0.8328] is the mean of this dimensionless score over 20 groups, with a 95% group-bootstrap interval. 0.6537 is a separate quantity: task-macro normalized mean absolute prediction error over three RH20T descriptors, of which speed and jerk are transferred.
Why four research questions? Better prediction on held-out demonstrations (RQ1) does not mean the robot has an action that can produce the desired change (RQ2). Having such an action does not show that the matched source leads to a better choice than the swapped source (RQ3). And a useful local choice does not establish that a second decision preserves its benefit (RQ4). These tests distinguish the value of the source information from what the robot can do with it.
How to verify the results. The source study uses 168 real RH20T teleoperation trajectories. The V23 control study contains 440 simulator runs, and the integrity audit found exact action and state agreement for paired prefixes. Figs. 1–2 show RH20T camera images and ManiSkill rollout frames; the numerical plots use saved results. In the anonymous supplement, reproduction/scripts/reproduce_core_results.py recomputes the main statistics from the archived data, including the matched-versus-swapped comparison.