- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how generative robot policies can adapt to constraints during deployment without requiring modifications to the pre-trained base policy. Building on the "Dynamic Negative Guidance" (DNG) method, the authors extend the negative guidance mechanism to closed-loop diffusion policies and derive a joint-complement formulation to avoid multiple mutually exclusive undesirable outcomes. The framework is implemented in two scenarios: language-conditioned avoidance, which converts learned positive conditioning into negative guidance signals; and failure-driven avoidance, which utilizes an auxiliary diffusion policy—trained on deployment-time failure cases—to provide negative guidance. Additionally, the authors explore the adaptive extension of this method to flow-matching policies.
Experiments cover object grasping, target placement, Push-T tasks, charger insertion, real-world manipulation, and LIBERO-Goal tasks based on the π0 policy. The results demonstrate that Dynamic Negative Guidance achieves a favorable trade-off between avoiding undesirable outcomes, completing tasks, and preserving behavioral diversity; furthermore, the failure-driven guidance mechanism effectively enhances system performance across various deployment environments.
Critical strengths
-
Addresses practical issues within a unified framework. This paper explores the practical challenge of adapting pre-trained robot policies to new deployment constraints without retraining the base policy. The unified negative guidance framework supports both language-guided obstacle avoidance and failure-feedback-based correction. Evaluations consider both task completion and the preservation of other effective behavioral patterns.
-
Shows great promise across various manipulation tasks. Experiments cover tasks such as object grasping, obstacle avoidance, and charger insertion. The results based on failure feedback are particularly encouraging, showing significant improvements in success rates—especially for the Push-T and charger insertion tasks. Experiments with real robots and extensions to the π0 model further demonstrate the method's potential applicability.
-
Clear overall presentation. The paper is well-written and logically organized. The research motivation, the proposed framework, and the experimental results are all clearly and accessibly presented.
Critical weaknesses
1. Limited methodological innovation and insufficient validation of the proposed extensions.
The core methodology is primarily built upon Dynamic Negative Guidance (DNG, ICLR 2025), a fact clearly stated in Section 3.1 (Page 3, Equations 2–3). The multi-objective extension proposed in Section 3.2 (Pages 3–4, Equations 4–7) is derived directly from the assumption that the outcomes are mutually exclusive. However, the paper lacks ablation studies comparing the proposed "joint-complement" formulation against a simple combination of independent, single-objective DNG corrections; this makes it difficult to assess the actual contribution of the extension.
Similarly, the failure-driven approach in Section 3.3 (Page 5, Equation 12) essentially replaces "language-conditioned negative scoring" with "scoring learned from failure trajectories." While the performance gains shown in Tables 5–6 are encouraging, the experiments fail to adequately distinguish the specific benefits of this design beyond the mere application of existing negative guidance techniques to an auxiliary failure model.
Furthermore, in the language-conditioned experiments (Section 4.1 and Appendix 7.3), the policy has already learned positive instructions for specific goals. A simple alternative would be to select an admissible goal at the start of an episode and execute its corresponding positive instruction. The paper lacks a comparison against this baseline.
Overall, while the method's application to robotic manipulation tasks is significant, the paper has not convincingly demonstrated that its proposed extensions offer an independent methodological contribution compared to existing guidance mechanisms and simple alternatives.
2. Inadequate control in baseline comparisons; performance gains depend on specific metrics.
The experimental results fail to clarify whether the reported performance improvements stem from the proposed dynamic weighting mechanism or from differences in effective guidance strength. Specifically, Appendices 7.2.2–7.2.3 (p. 14, Equations 31–32) indicate that some language-conditioned experiments employed a fixed CFG coefficient (value of 3), whereas the DNG method utilized a coefficient dependent on posterior probabilities. Under the reported initialization settings ( and ), the initial effective DNG coefficient was merely 1 (compared to 3 for static CFG), and this coefficient typically decreased during the denoising process. A similar discrepancy exists in the experiments (see Appendix 7.1, p. 13). Consequently, the higher failure rates and mode collapse observed with static CFG may stem, in part, from its stronger effective guidance, rather than from the inherent superiority of the proposed adaptive mechanism.
Although Appendix Table 8 (p. 20) includes an ablation study on the scale coefficient, the results demonstrate that reducing the CFG scale coefficient from 3 to 1 improved the AUS from 0.800 to 0.830, thereby narrowing the gap with the proposed method's best score (0.851). Therefore, a more comprehensive comparison involving properly tuned static guidance and simple decaying guidance strategies is warranted.
Furthermore, the magnitude of performance improvement depends, to some extent, on the chosen evaluation metrics. In Table 1 (p. 6), static CFG achieved a higher "constraint-satisfying task success rate" across all four object-grasping scenarios; the proposed method attained a higher AUS because it tends to maintain uniformity among the remaining valid results. For instance, in the task involving avoiding a cube, CFG achieved an effective success rate of 90.0%, whereas the proposed method achieved 86.0%. Appendix Table 7 (p. 17) further shows that when the uniformity weight is reduced to 0.1, CFG outperforms the proposed method in terms of the average AUS metric for object-grasping tasks.
These results suggest that the advantages claimed in the paper should be interpreted with caution—viewing them as a trade-off between constraint satisfaction and behavioral diversity rather than an across-the-board improvement in task completion quality. To robustly support the paper's core empirical conclusions, stronger baselines and a clearer distinction between evaluation metrics are required.
Questions for authors
Q1. Contribution of the multi-target formulation.
In Section 3.2 (Eqs. 4–7), the joint-complement formulation follows from the assumption of mutually exclusive outcomes. Could the authors clarify what practical advantage the shared denominator provides over simply combining independent single-target DNG corrections? Can we add an abslation.
Q2. Fairness of the guidance baseline comparisons.
According to Appendix 7.2.2–7.2.3, the initial effective DNG coefficient is 1 when the nominal scale is 3 and the prior is 0.25, whereas static CFG uses a fixed coefficient of 3. Could the authors provide comparisons with better-tuned static CFG, including smaller coefficients, and simple decaying guidance schedules? In particular, do the improvements in Tables 1, 4, 5, and 6 remain consistent when the effective guidance strengths are more closely matched? This would be important for determining whether the gains come from the proposed adaptive mechanism.
Q3. Necessity of negative guidance in the language-conditioned setting.
In Section 4.1 and Appendix 7.3, the base policy is already trained with target-specific positive instructions. For the closed-set object-picking and charger-insertion tasks, could the authors compare against selecting an allowed target at the beginning of each episode and executing its corresponding positive instruction? Such a baseline could potentially achieve constraint satisfaction while preserving diversity across episodes.
5 comments
W2 / Q2. Matched-strength CFG, decay controls, and distribution fidelity
We agree that comparing the same nominal scale is insufficient: for single-target DNG, , so with begins at effective coefficient 1, not 3. We therefore added smaller static-CFG coefficients, matched-initial-strength controls, and deterministic decays.
Banana avoidance (200 episodes per setting). The complete original Table 8 scale sweep, supplemented with new CFG controls, gives:
| Method | Scale/schedule | Forbidden banana ↓ | Valid success ↑ | AUS ↑ |
|---|---|---|---|---|
| DNG | 1 | 7.0% | 83.0% | .811 |
| DNG | 3 | 1.5% | 89.5% | .851 |
| DNG | 5 | 2.5% | 88.5% | .844 |
| DNG | 10 | 1.5% | 93.0% | .829 |
| CFG | 0.5 (new) | 9.0% | 83.5% | .793 |
| CFG | 1 | 3.0% | 91.5% | .830 |
| CFG | 1.5 (new) | 1.5% | 93.0% | .829 |
| CFG | 2 (new) | 1.5% | 91.5% | .812 |
| CFG | 3 | 1.0% | 93.0% | .800 |
| CFG | 5 | 1.5% | 93.5% | .783 |
| CFG | 10 | 1.5% | 91.0% | .734 |
| CFG | linear 1→0.5 (new) | 4.5% | 86.0% | .790 |
The key advantage in picking is preservation of alternative valid behaviors, not maximal raw success. DNG-3 selects cube/apple/cup at 37.0/20.0/32.5%, versus 53.5/9.0/30.5% for CFG-1.5, despite both selecting banana only 1.5% of the time. To separate this effect from AUS's preference for uniformity, we calculated total variation (TV) distance to the base policy's renormalized distribution over allowed successful objects. At matched observed avoidance, DNG-3 has TV 0.063 versus 0.190 for CFG-1.5. CFG-0.5 has similarly low TV (0.065), but selects banana 9.0% of the time. Hence weaker fixed CFG does not match the same avoidance–fidelity trade-off. We acknowledge CFG-1.5 has higher raw valid success (93.0% versus 89.5%).
This conclusion extends beyond AUS: recomputing TV from the original outcome frequencies, DNG is closer to the renormalized base distribution than CFG in 4/4 object-picking conditions (mean TV 0.259 vs. 0.455) and 9/10 charger conditions (mean 0.202 vs. 0.355). Across these ten charger conditions, mean constraint-valid success is 58.6% for DNG, versus 51.6% for CFG and 33.4% for the unguided policy.
Matched-strength three-target charger insertion. For forbidden receptacles (1,4,5), three priors of 0.2 yield initial DNG coefficient per branch. On the same 80 environment seeds, matched static-CFG comparisons yield:
| Initial coefficient | DNG valid ↑ | Static CFG valid ↑ |
|---|---|---|
| 1.0 | 62.5% | 25.0% |
| 1.5 | 67.5% | 31.25% |
| 2.0 | 73.75% | 30.0% |
At initial coefficient 1.5, exponential CFG decay to 1.3 or 0.75 yields 28.75% or 23.75% success, versus 67.5% for DNG. This result is from one selected charger configuration, not all settings.
These controls show that the favorable avoidance–fidelity trade-off in picking and valid-success performance in this multi-target charger setting cannot be explained solely by an overly strong CFG baseline or the tested decay schedules. We will report raw success, forbidden rates, and distribution fidelity separately. We do not claim that these controls exhaust all CFG schedules or establish matched-strength superiority for every and failure-driven experiment.
Q3. Positive-target selection versus negative guidance
We thank the reviewer for proposing this natural baseline. We implemented it for the closed-set charger task using the original pretrained policy, with no additional training. At episode initialization, we select an admissible receptacle either uniformly or proportionally to the unguided policy's observed frequencies, then execute its positive instruction throughout the episode.
Across 200 episodes per method and avoidance condition, we obtain:
| Forbidden targets | Selection | Valid success ↑ | Forbidden ↓ | Failure ↓ |
|---|---|---|---|---|
| (1,2,4) | Uniform | 75.0% | 7.5% | 17.5% |
| (1,2,4) | Base-proportional | 76.5% | 6.5% | 17.0% |
| (1,4,5) | Uniform | 84.5% | 3.0% | 12.5% |
| (1,4,5) | Base-proportional | 84.5% | 3.0% | 12.5% |
These are strong results, and positive selection can outperform negative guidance in this closed-set setting. We will include this baseline and clarify the scope of our claim.
However, the methods address different deployment information assumptions. Positive selection presumes that (i) the complete set of admissible goals is known, (ii) each has a reliable positive instruction, and (iii) the robot can commit to a selected replacement goal. Base-proportional selection additionally uses estimated base-policy frequencies for those goals. These assumptions hold in our controlled five-receptacle task, but need not hold when a robot is given only what not to do.
This distinction is especially important for deployment failures. A newly encountered obstacle in Push-T may identify unsuccessful trajectories without revealing any successful replacement trajectory, let alone a finite list of positive targets. Our failure-driven approach trains an auxiliary negative model on unsuccessful rollouts and redirects the frozen base policy away from those behaviors, without enumerating or positively labeling successful alternatives. At a single fixed DNG scale of , this improves performance in all six failure-driven deployment conditions in Tables 5–6.
Thus, positive-target selection is preferable when admissible alternatives are fully specified; negative guidance is valuable when exclusions or failures are known but positive replacements are not. We will present both methods as complementary rather than claim universal superiority of negative guidance.
W1 / Q1. Methodological contribution and joint-complement ablation
We thank the reviewer for the constructive assessment. We acknowledge that single-target Dynamic Negative Guidance (DNG) was introduced for image generation. Our contribution is not to reinvent that mechanism, but to formulate and evaluate negative behavioral steering for physically executed, closed-loop robot policies, together with multi-target, failure-driven, and flow-matching extensions.
Why the robotics setting matters. In image generation, negative guidance suppresses undesirable visual content. In robotics, generated action chunks are executed: they alter subsequent observations, task feasibility, and future policy decisions. A behavior that succeeded during training (e.g., insertion into a receptacle) may become forbidden at deployment. Simply suppressing that outcome is insufficient unless the robot still completes the task through an allowed alternative. In Table 2, when receptacles (1,2,3) are forbidden, rejection sampling reduces forbidden selections to 12.5% but incurs 46.0% failures (41.5% constraint-valid success); DNG achieves 9.5% forbidden selections, 19.5% failures, and 71.0% constraint-valid success. This demonstrates the distinct avoidance–completion challenge of embodied steering. We do not claim a cross-chunk posterior-consistency guarantee.
Why joint-complement guidance differs from independent composition. For mutually exclusive negative outcomes with posterior probabilities pi, the desired joint complement is proportional to pt(xt)(1−∑ipi), whereas independent single-target composition corresponds to pt(xt)∏i(1−pi). Their score corrections therefore use, respectively,
gijoint=λ01−∑jpjpi,giind=λ01−pipi.
The shared denominator explicitly accounts for the total forbidden probability mass without enumerating allowed targets. We agree that this is a natural extension of DNG, rather than a new probability identity.
New ablation. We implemented independent single-target DNG and evaluated both formulations on charger insertion. At the same nominal scale 3, over 200 episodes per condition, joint DNG improves constraint-valid success from 51% to 54% for forbidden targets (1,2,4), and from 46% to 48% for (1,4,5). Since nominal scales do not match initial effective strengths, we additionally performed a matched-coefficient sweep on 40 common seeds (101–140). At initial coefficient 2.0 per branch (joint scale 4; independent scale 8), joint DNG obtains 42.5% versus 35.0% valid success, and 12.5% versus 22.5% forbidden selections. The ranking changes at other coefficients; thus, we claim a principled joint-complement formulation, not universal superiority over independently composed guidance.
Failure-driven and flow-matching extensions. Deployment failures reveal what to avoid, but need not provide a successful replacement trajectory. Our auxiliary failure diffusion policy supplies that negative distribution while keeping the pretrained base policy frozen; at a single fixed scale λ0=2, this improves performance across all six obstacle and unavailable-receptacle conditions in Tables 5–6. For flow-matching π0, we derive a complement-velocity relation and a state-dependent surrogate instead of reusing DNG's stochastic posterior update. On LIBERO-Goal, A2 avoidance reduces forbidden outcomes 10 to 3, and A4+A2+A5 avoidance reduces 25 to 6, with the baseline's 18/100 failures unchanged in both cases.
We will sharpen these methodological distinctions and limitations in the revision.