- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Network latency makes teleoperation imprecise, and existing learned predictive displays only work at the single delay they were trained for. The authors instead use a DINO-WM-based world model that steps forward one prediction at a time from the latest received frame, with a separate thread re-anchoring it to new observations, so any delay or jitter is handled at runtime without retraining. In a 22-person study on a simulated Push-T task with 500–1000 ms delays, it cut completion time by 23.5% and reduced move-and-wait behavior, though users rated it less authentic than the delayed feed. The paper lists three contributions: making the compensated delay a runtime quantity rather than a training choice, an operator-in-the-loop evaluation, and support for non-constant delay by construction, the last of which the authors state is not empirically tested.
Critical strengths
The paper applies an interactive world model as a predictive display for teleoperation, addressing the long-standing problem of time delay in this setting. The authors implement the full system and evaluate it in a human-subjects experiment with 22 participants. The main strength is this attempt to put a learned world model into a teleoperation system and measure its effect on real operators.
Critical weaknesses
The paper aims to compensate for network latency in teleoperation, which it states degrades precision and fine manipulation. However, the user study reports only completion time, timeout rate, and control-input statistics; no accuracy or precision metric is evaluated. The only related quantity, end-effector path length, actually increased by about one metre under compensation, which might suggest less precise motion. This matters because the central claim of the paper, that the predictive display restores precision lost to delay, is left unsupported by the evidence presented.
DINO-WM is used with its architecture and hyperparameters essentially unchanged. The technical contribution therefore reduces to a two-thread inference scheme. The one property the paper claims distinguishes it from prior learned predictive displays, operation under variable delay without retraining, is never tested. The evaluation is confined to a simplified simulated Push-T task with fixed poses and a 2D action space, with no real sensor data or real robot, and provides little evidence for real-world settings. Taken together, the novelty of the contribution, its technical validation, and the comprehensiveness of the evaluation should be greatly improved.
Questions for authors
-
This paper states that time delay in teleoperation degrades precision, but the reported metrics are completion time, timeout rate, and control-input statistics. If possible, it would be helpful to see a measure of placement accuracy or motion precision. It would also be helpful to know how the authors interpret the longer end-effector paths observed under compensation.
-
In the introduction, support for variable delay is presented as a key advantage over prior learned predictive displays. However, only constant delays are evaluated. If any results under jitter or packet loss are available, even preliminary ones, they would be valuable. Otherwise, it would help to clarify on what basis this is presented as a contribution.
-
It would be helpful to clarify whether anything in the world model itself is modified relative to DINO-WM beyond the data pipeline and the two-thread scheduling, and to state more explicitly what the authors consider the methodological contribution.
-
Since operator performance is shown to depend on prediction fidelity, any evidence of how fidelity behaves outside the fixed-pose Push-T setting, for example on a more complex simulated scene or real camera images, would help assess the generality of the approach.
We thank the reviewer for these concrete, specific points and address each in turn.
Precision metric and end-effector path length. Agreed - we report no continuous placement-accuracy metric, only behavioral proxies. The precision claim is motivation from prior teleoperation-delay literature, not a result of this study. On the increased end-effector path length: block path length is unchanged while idle fraction falls and reversal rate rises. Read together, we interpret this as continuous closed-loop correction, not imprecision: more hand motion and more direction changes converge on an equally direct object path. We’ve added this interpretation directly to that paragraph.
Variable delay. Correct that we evaluate constant delays only — the paper already flags this. We collected preliminary data: a pilot (n=5) adds per-tick jitter of +-2 and +-10 frames around the same three delays. The compensation advantage holds under jitter (HR = 1.69, p = .005) with no evidence it depends on jitter amplitude. Full design, tables, and caveats appropriate to n=5 are in a new appendix section; we present this as preliminary feasibility evidence, not a powered test, and the contribution claim now points there instead of standing untested.
What’s modified relative to DINO-WM, and the methodological contribution. To be precise: the world-model architecture itself (encoder, predictor, decoder) is unmodified DINO-WM. Our contribution is the two-thread display/grounding scheduling procedure that decouples per-frame inference cost from the delay, the feasibility/horizon-bound analysis characterizing exactly when this is possible given measured component latencies and the resulting property that delay is a runtime rather than a training-time quantity.
Fidelity beyond fixed-pose Push-T. We have no evidence to offer here — this is a genuine limitation, already stated. We don’t have grounds to predict how fidelity would behave on a more complex scene or real camera images and would rather say so than speculate.