- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work proposes adding the first derivative of the action as an auxiliary supervision in addition to the action itself. Feature analysis shows this helps significantly reduces the variance of the predicted action, and extensive experiments in both simulations and real robots show promising improvements from this additional supervision.
Critical strengths
- Extensive experiments give strong evidences on the effectiveness of the proposed method.
- Ablations in the variance of the predicted action clearly shows the mechanism of the proposed method on improving the final robot learning results.
Critical weaknesses
- Novelty introduction seems not complete enough. Using absolute action and delta action as action representations have long been used in diffusion-based policies. Therefore, I encourage the authors to either (1) add a related works on this topic; (2) claim combining the action and its derivative together instead of claiming using the derivative for the first time; or (3) demonstrate the diff between the action delta and the derivative introduced, more explicitly.
- Multi-modality. While having the action and its time derivative can reduce the variance in denoising, it could also average the actions from different modalities. Further research into this, especially testing the proposed method on those naturally multi-modal test cases would be interesting, and important for applications where multi-modality is critical.
- Ablations on orders of derivatives for supervision. Since the manuscript proves the 1st derivative effective, it will be interesting to see whether the 2nd derivative, the 3rd, ... would work, and what is the optimal order to be included? This ablation would make the work more comprehensive. Given the low dim nature of actions, I think there is little obstacle in adding dim to the diffusion.
Questions for authors
I recommend weak accept as I expect the authors can resolve most questions in critical weaknesses.
Thank you for the detailed responses and the additional experiments. The clarifications and revisions addressing Questions 1, 2, and 4 are clear and have resolved my main concerns. I appreciate the explanation of the conditional and marginal velocity fields, the comparisons with simpler temporal regularizers and the JVP ablations, and the additional evaluation details and matched OGBench baseline reruns.
Regarding Question 3, I would still encourage the authors to revise the wording in the main text, particularly the statement that the standard flow-matching objective “can be biased.” Standard FM can, in principle, model the joint action-chunk distribution, including its temporal correlations. The absence of an explicit physical-time derivative constraint does not by itself imply bias in this distribution-matching objective. Likewise, failing to satisfy the additional trajectory-conditioned compatibility condition is distinct from failing to recover the correct action distribution.
The additional temporal-difference results provide useful evidence that the proposed supervision improves the temporal accuracy of the learned policies, but they do not establish that the standard FM population objective is biased. A more precise formulation would be that standard FM does not explicitly enforce the proposed physical-time derivative compatibility, and the auxiliary objective provides a useful inductive bias that improves learning in the evaluated settings. Please align the corresponding statements in the abstract and introduction with this distinction.