- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper introduces Noise-Gated Diffuser (NgD), a method to train diffusion policies on a combination of expert and broader sub-optimal experience data. NgD predicts future states (in latent space) and actions conditioned on current sensor observations. It choose a noise-gate parameter for learning from broad experience, which restricts learning of the denoiser to high-noise timesteps of the diffusion process. Expert demonstrations are used normally in the diffusion process.
Critical strengths
-
Learning from Sub-Optimal Data is a Topical Problem: As robotics datasets scale, its important to study how to use the broad experience data which might be sub-optimal but still useful learning.
-
Noise Gating in Diffusion is an Intuitive Idea: Restricting sub-optimal data to learning only when they are in the high-noise timesteps of diffusion makes sense. This only affects the early denoising process which is more important for high-level guidance and semantics. The expert demonstrations can guide the policy.
Critical weaknesses
- Positioning of Contribution Relative to Prior Work: The idea of utilizing sub-optimal data by noise-gating has been explored by prior works. X-Diffusion [1] restrict cross-embdoiment data mismatched in dynamics to high-noise timesteps. Ambient Diffusion Policy [2] restricts sub-optimal data between a low-noise and high-noise threshold. These works should be cited and compared against. It's not clear if the paper introduces new methods compared to these papers.
[1] Maximus A. Pace, Prithwish Dan, Chuanruo Ning, Atiksh Bhardwaj, Audrey Du, Edward W. Duan, Wei-Chiu Ma, Kushal Kedia. "X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrations." ICRA 2026. arXiv:2511.04671.
[2] Adam Wei, Nicholas Pfaff, Thomas Cohn, Arif Kerem Dayı, Constantinos Daskalakis, Giannis Daras, Russ Tedrake. "Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Robotics." arXiv:2606.12365, 2026.
-
Manual Tuning of Noise Gating Parameter: Compared to [1] and [2], this work has to manually tune the noise gating parameters. These other works instead learn a classifier which can decide which noise level for each data sample seperately depending on how close they are to expert data.
-
Limited Realworld Experiments: The method is validated on 2 quasi-static manipulation tasks. How does performance vary with more dynamic tasks?
-
Minimal Performance Improvements Relative to Data Pooling: The gains from noise-gating are minimal compared to just pooling both data sources and training on the mixture.
Questions for authors
- Can you clarify the positioning of this work relative to prior noise-gating approaches for generative control? [1,2]
- Does the noise gating parameter need to be manually specified?
- Can the noise gating parameters be applied differently to different samples and domains?
[1] Maximus A. Pace, Prithwish Dan, Chuanruo Ning, Atiksh Bhardwaj, Audrey Du, Edward W. Duan, Wei-Chiu Ma, Kushal Kedia. "X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrations." ICRA 2026. arXiv:2511.04671.
[2] Adam Wei, Nicholas Pfaff, Thomas Cohn, Arif Kerem Dayı, Constantinos Daskalakis, Giannis Daras, Russ Tedrake. "Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Robotics." arXiv:2606.12365, 2026.
3 comments
-
On minimal gains relative to naive pooling (W4): We would like to clarify that naive pooling generally degrades performance on simulated benchmarks, as shown by “NP” columns in Table 1. Across three benchmarks, NGD significantly outperforms both DP and Joint State-Action Models trained by naively pooling both data sources. Compared with Joint State-Action Models trained on naively pooled data, NGD improves average performance by 42.8%, 18.1%, and 78.9% on Robomimic, DexMimicGen, and real-robot evaluations. In our extended real-robot experiments above, NGD also substantially outperforms both its ungated variant (NGD w/ ) and Joint State-Action Models naively trained on pooled data.
-
On the adaptive use of noise-gating parameters across samples and domains (Q3): NGD’s gating formulation allows thresholds to vary across samples or domains, and using a shared threshold is a design choice rather than a requirement. In our experiments, a fixed threshold of 0.6 already achieves strong real-robot performance across different evaluation settings and tasks, suggesting that per-sample adaptation is not necessary for effective use of prior data with our approach. Meanwhile, we agree that developing an adaptive threshold-selection method is a promising direction for future work and have included this discussion in the revised Appendix D.
A Gentle Reminder
Dear Reviewer TfDN,
As the discussion period is closing soon, we wanted to send a gentle note to check whether our rebuttal and the revised manuscript have addressed your concerns. If anything remains unclear, we would be glad to provide further clarification. Otherwise, we would greatly appreciate it if you could let us know whether the updates resolve your questions as you finalize your assessment. Thank you again for your time and thoughtful review.
The Authors
We thank Reviewer TfDN for their constructive feedback. We kindly refer the reviewer to our general response for the conceptual differences from X-Diffusion and Ambient Diffusion Policy (item 1), the baseline comparison (item 2), and the extended real-robot experiments with a fixed threshold, including a new deformable task (item 3). We also address the listed concerns below:
On the positioning of NGD relative to prior work (W1, Q1): X-Diffusion [1] and Ambient Diffusion Policy (AmbientDP) [2] both optimize suboptimal samples at noise levels where they become indistinguishable from the noised expert ones. In contrast, NGD neither restricts denoiser training to high-noise diffusion timesteps nor uses distributional indistinguishability to admit prior supervision. Noise thresholds in NGD select conditional action-outcome prediction objectives by determining how much information in the conditioning modality is available for prior data to supervise the prediction of the other. For example, a high future-state threshold demands the future state to be nearly clean for prior data to supervise the prediction of the action chunk, regardless of the action’s own noise level. We discussed AmbientDP in our initial related work. We have added X-Diffusion and discussed how these prior works differ from our approach in the revised related work.
On the Ambient Diffusion Policy baseline (W1): We have updated Table 1 to include results from AmbientDP on simulated benchmarks following the same training and evaluation protocols as NGD. For fair comparisons, we swept noise thresholds per benchmark within a budget similar to NGD and report AmbientDP results using the best benchmark-level threshold. We observe that NGD effectively outperforms AmbientDP across the evaluation benchmarks. Further details are provided in Appendix B.
On the manual threshold selection (W2, Q2): While X-Diffusion [1] and AmbientDP [2] train a task- or dataset-specific classifier to decide the threshold for the high-noise interval, AmbientDP manually selects the threshold for the low-noise interval in real-robot experiments, and reports the difficulty of using a classifier-based approach for identifying a meaningful low-noise threshold in Appendix H.1 of [2]. Although the noise threshold is also a hyperparameter to be selected in our framework, we demonstrate the robustness of our approach by using a fixed threshold across extended real-robot evaluation settings, where we use a new set of prior trajectories from DROID [3] and introduce additional evaluation configurations for the two initial tasks along with a new real-robot task. In the results below, we observe that a fixed threshold of 0.6 in our approach robustly transfers across different prior data and yields non-trivial improvements on various real-robot tasks and evaluation settings, reducing the need for hand-picking thresholds across task settings.
On an additional real-robot dynamic task (W3): We present additional results on a deformable object manipulation task (Towel Hanging) in our extended real-robot evaluation. The task requires a robot arm to grasp and successfully mount a towel onto a rack. Throughout the task, grasping locations and contact forces dynamically alter the towel’s shape, directly influencing the required execution of the hanging motion. NGD with a fixed threshold of 0.6 remains robust and effectively improves task performance, as shown by the results below. We also provide the evaluation videos for this task on an anonymous website: https://ngd-rebuttal.pages.dev/.
[1] Pace et al. X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrations. ICRA, 2026
[2] Wei et al. Ambient Diffusion Policy: Imitation Learning from Suboptimal Data in Robotics. CoRL, 2026
[3] DROID Team. DROID: A Large-Scale In-the-Wild Robot Manipulation Dataset. RSS, 2024