- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
This paper proposes a method to train policies that are sensitive to training-inference mismatches in physical time w.r.t actions, observations/other sensors.
Critical strengths
The paper is easy to read and follow for the most part. The experiments clearly demonstrate the effectiveness of the method against a baseline that does not use it.
Critical weaknesses
The set of baselines used for comparison are insufficient, as the main comparison is with Diffusion Policy. The main novelty is temporal awareness with RoPE embeddings, which will be better substantiated by thorough empirical comparison with more baselines, even if the tasks/environments for such comparison are much fewer in number.
Questions for authors
-
It's not clear why some experiments include comparison with RTC and some do not. There are also other approaches eg. DiscreteRTC (which you've cited), "Delay-Aware Diffusion Policy: Bridging the Observation–Execution Gap in Dynamic Tasks", "FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking" etc. that claim to work in similar time-mismatch scenarios. Please add additional comparisons.
-
Fig. 3 was hard to follow. Please add details about what each baseline does where relevant.
-
Does the Diffusion policy share the same architecture as the Chronos policy (other than the time-aware embeddings)
3 comments
I thank the authors for their detailed response. The new comparisons show Chronos as a simple yet effective method. I think this is a meaningful contribution and therefore, increase my score to 4.
Thank you so much for your thoughtful feedback and encouraging comments! We sincerely appreciate your recognition of our work and your willingness to reconsider the score. We are very grateful for your time and consideration!
Response to Reviewer NSQB
Thank you for your kind words and insightful suggestions on our paper.
We have expanded the simulation comparisons to include DP with latency compensation (DP + LC), RTC, DiscreteRTC, Delay-Aware Diffusion Policy (DA-DP), FutureRTC, and a timestamp resampled baseline.
We thank the reviewer for pointing this out. Figure 3 compares five variants to study the effects of time representation and temporal randomization:
DP: Standard Diffusion Policy without explicit timing or temporal randomization.
DP + Randomization: DP trained with temporal randomization but without explicit timing.
RoPE without Randomization: Uses physical-time RoPE but is trained without temporal randomization.
AddTime: Uses additive timestamp embeddings together with temporal randomization.
Chronos: Uses physical-time RoPE together with temporal randomization.
Temporal randomization varies the observation sampling times and action execution times during training. The results are averaged across three training seeds, with 150 evaluation episodes per seed for each condition. The average performance under timing perturbations is computed across the five non-nominal conditions, and error bars show the standard deviation across seeds.
We will add these details to the figure caption to make the comparisons clearer.
Yes, DP and Chronos Policy share the same transformer backbone.