- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces Data Inoculation (DI), teleoperation data collection method. A residual policy adds a bounded perturbation to the teleoperator's command, and the policy is learned via off-policy RL on the growing dataset. The authors argue that the resulting perturbations mimic the deviations a downstream policy would make, so that teleoperation corrections produce targeted recovery data. On three real robot tasks, DI improves or matches downstream BC and offline RL success rates relative to clean teleoperation and uniform random perturbations.
Critical strengths
- The paper is easy to follow. The topic is well motivated, and the paper does a good job outlining and connecting to relevant literature.
- The physical robot experiment setup is good; 3 tasks + multiple seeds and sufficiently challenging
Critical weaknesses
My primary concern is that the empirical setup only compares DI with random action perturbation (a naive baseline) and no perturbation. Why not compare to DART and Dagger? Both target the same failure mode DI addresses (DART fits its noise to the learner’s errors, similar to DI). If either is incompatible with this setting I think ADC (Huang et. al 2025) is another relevant baseline but perhaps does not fit the specific RL setting this paper considers. In such case, the paper should describe why relevant/related baselines are excluded if there's a good reason. While I would agree that current experiments do answers the questions Q1-Q3 posed in the paper, missing baselines makes the utility of the method difficult to assess.
Experiments only consider 3 real world robotic tasks. This is a good physical evaluation, but giving that error bars are pretty close or overlapping in some setups (especially keycap), additional simulated experiments (e.g. similar to those in the DART paper) would strengthen the paper. The lack of improvement over clean in keycap means that we only have 2 tasks that show clear improvement. It may be difficult to run additional physical experiments, but simulated experiments can still provide useful signal and as easier to run.
Questions for authors
Why does the evaluation exclude DART and DAgger-style interventions?