- Rating
- 1(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper is about diffusion generation under constraints available only as binary evaluations of final samples. It learns a Doob h-function on noised labeled data and guides a frozen diffusion model with its log-gradient. Experiments on MNIST, CIFAR-10, QM9, and Stable Diffusion 1.5 evaluate constraint satisfaction, sample quality, and sampling efficiency.
Critical strengths
- Coherent formulation and analysis. The paper connects binary supervision, the Doob h-function, and the resulting guidance rule together. Method design and experiments are coherent, providing evidence to support the claims.
Critical weaknesses
- The experiment conditions are too simple to establish effectiveness on more complex constraints. The experiments primarily use digit or class labels, low-level image statistics, grayscale conversion, and basic molecular property thresholds or ring presence. The composition experiments also offer limited evidence about strongly dependent constraints.
- The incremental contribution over existing classifier guidance is limited. The paper's idea is already encompassed by classifier guidance. Standard classifier guidance also retains the guidance magnitude. The paper doesn't establish a sufficiently substantial advance over the existing formulation to support acceptance.
Questions for authors
-
Clarification of the theoretical contribution: Which part of the method establishes a new result beyond the existing classifier-guidance and Doob h-transform formulations? What additional conclusion does it support about the proposed sampler?
-
Generality of the central empirical finding: Table 2 uses standard classifier guidance to demonstrate the benefit of retaining magnitude differences across samples, but only for two simple CIFAR-10 predicates. Since this analysis is a central contribution, can you demonstrate the same benefit for a more complex constraint, with the schedule and mean step size matched and sample quality comparable?
5 comments
Response to Reviewer zHSD (2/2): dependent conjunction and molecular constraint
3. Composition of strongly dependent constraints
This experiment addresses a separate aspect of generality: whether independently trained heads remain useful when the two constraints are strongly dependent. Red-pixel and low saturation co-occur in 1.28% of CIFAR-10 training images, against 6.69% under independence. Guiding with the sum of the two separately trained log-heads, with no joint training:
| γ | Joint satisfaction (%) | Red-pixel | Low saturation | Product of guided marginals |
|---|---|---|---|---|
| 0 | 0.5 | 31.4 | 15.1 | 4.7 |
| 2 | 30.4 | 84.2 | 39.5 | 33.3 |
| 5 | 62.5 ± 2.0 | 97.0 | 64.0 | 62.1 |
| 10 | 83.4 ± 0.3 | 97.6 | 83.9 | 81.9 |
(3 seeds × 1,000 samples at γ = 5 and 10; seed 0 otherwise.) Joint satisfaction rises from 0.5% without guidance to 83.4% at γ = 10, and the result is reproduced over three seeds at the two larger scales. Composition is therefore effective for this strongly negatively dependent pair, with heads trained once per constraint and combined at sampling time. Exact additive composition requires conditional independence given the noisy state, which is not assumed here; the experiment shows successful joint satisfaction for one dependent pair and is not a guarantee for arbitrary constraints.
4. Matched-budget experiment on the dependent conjunction
To test the allocation effect on a compound constraint, we ran the matched-budget comparison on this same conjunction. The direction is the gradient of the summed log-heads, the mean step at each timestep is measured along the standard-guidance trajectories, and the 1/ĥ rule uses the product of the two heads (3 sampling seeds × 1,000 samples; joint satisfaction %, mean ± standard deviation, and mean FID_c against the test images that satisfy both predicates).
| γ | Standard | Equal step | 1/ĥ-weighted |
|---|---|---|---|
| 5 | 62.5 ± 2.0 / 118.6 | 57.3 ± 2.2 / 118.8 | 61.6 ± 2.0 / 118.5 |
| 10 | 83.4 ± 0.3 / 131.1 | 76.1 ± 0.4 / 131.5 | 80.4 ± 1.1 / 133.6 |
The equal step lowers joint satisfaction in all six seed-level comparisons, by 5.2 points on average at γ = 5 and by 7.3 points at γ = 10, where all three seeds show losses between 7.0 and 7.6 points, while FID_c stays within 0.5 of the standard rule. Restoring only the inverse-probability weighting recovers 82% of the mean loss at γ = 5 and 59% at γ = 10. Because the two events are dependent, the product of the heads is not assumed to equal the true joint conditional probability; the recovery is an empirical result of the controlled reweighting. The allocation effect therefore holds for a rare, negatively dependent conjunction guided by two separately trained heads, with the same controls as in the original experiment.
5. Matched-budget experiment on a molecular constraint
To take the comparison beyond image predicates, we ran it on the Lipinski-type molecular filter used in the paper. This is a programmatic molecular property constraint: an RDKit program on decoded molecules, with no gradient and no noisy-state evaluation. The sampler is the one used in the paper, and the three rules are the same as before, with the mean step at each timestep measured along the standard-guidance trajectories (3 sampling seeds × 1,000 molecules; satisfaction %, mean ± standard deviation, with mean uniqueness / novelty % in parentheses; validity is 100% in every run).
| γ | Standard | Equal step | 1/ĥ-weighted |
|---|---|---|---|
| 2 | 87.4 ± 0.5 (93.8 / 95.4) | 86.3 ± 1.2 (93.1 / 96.3) | 87.8 ± 0.7 (93.2 / 96.1) |
| 5 | 93.7 ± 0.4 (89.5 / 94.4) | 91.0 ± 0.7 (89.5 / 95.3) | 93.5 ± 0.9 (89.2 / 94.7) |
The equal step is lower in all six seed-level comparisons. At γ = 5 the loss is 2.7 points on average, between 1.5 and 3.3 points across the three seeds, and the inverse-probability weighting recovers over 90% of it. At γ = 2 the loss is 1.1 points, in the same direction in all three seeds. Validity is 100% under all three rules, and uniqueness and novelty differ by less than one point between them, so the loss in satisfaction is not offset by a gain in validity, uniqueness or novelty. The allocation effect therefore carries over to a programmatic molecular constraint in a different generative domain.
Follow-up to Reviewer zHSD: complex constraints and an independent estimator
We thank the reviewer again for the thoughtful questions, which helped shape the additional experiments. Two findings bear directly on the concerns raised.
On generality beyond simple constraints: we extended the matched-budget evaluation to more challenging settings, preserving the reference timestep-wise mean-step schedule, at comparable sample quality. On the semantic class ship, equal-step guidance lowers satisfaction by 8.5 and 8.2 points across two seeds at γ = 5. On a strongly dependent conjunction, it lowers joint satisfaction from 83.4 ± 0.3% to 76.1 ± 0.4% at γ = 10, with FID_c differing by less than 0.5. On the QM9 molecular property filter, satisfaction decreases from 93.7 ± 0.4% to 91.0 ± 0.7% at γ = 5, with validity remaining at 100%.
On the contribution beyond existing classifier guidance: we also repeated the matched-budget experiment using the independently developed Spectral Guidance estimator, trained with a different objective. Equal-step guidance again lowers satisfaction in all four tested configurations (1.8–5.9 points, across three sampling seeds). Together with the more complex constraint experiments, this demonstrates that the magnitude-allocation effect extends beyond our particular estimator and the original image predicates. Our contribution is to isolate this effect under a controlled guidance budget and provide a protocol through which other conditional-guidance methods can evaluate it.
We sincerely appreciate the reviewer's feedback, which helped strengthen the scope and experimental validation of our findings. We will incorporate these results and their implications into the revised manuscript.
Response to Reviewer zHSD (1/2): contribution and class constraints
We thank the reviewer for the careful reading. We address the contribution of the paper first, then the experiments on more complex constraints, including a dependent conjunction and a molecular constraint, and the composition of dependent constraints.
1. Contribution beyond classifier guidance and the Doob h-transform
The distinction that matters is between the established guidance formula and the question this paper studies. Standard classifier guidance already uses the unnormalized logarithmic gradient ∇log h. The paper isolates what the relative magnitude of that gradient contributes to hard-constraint satisfaction, independently of its direction, of the timestep schedule and of the average guidance budget.
The finding is quantitative and bears directly on sampler design. In the matched-budget experiment of the paper, giving every sample an equal step while keeping the mean step at each timestep lowers satisfaction by 17.0 to 18.5 points at comparable FID_c, and restoring only the inverse-probability weighting recovers a large part of the loss. During the discussion period we extended the comparison to 32 configurations and three estimator families, including the independently trained estimator of Spectral Guidance. The allocation of magnitude is therefore not an incidental feature of our architecture. It is a measurable aspect of conditional guidance, and its effect can be tested separately from the quality of the estimator and from the overall guidance strength.
The theory characterizes the hard-constraint setting in which this takes place. Theorem 1 gives the bounded-solution characterization of h for a discontinuous terminal indicator and identifies the exact conditional dynamics: with the exact score, the exact h and the conditional initial law, the correction at γ = 1 is the Doob-transformed process. Proposition 2 quantifies how the constraint signal contracts under forward noising, and Proposition 3 distinguishes the data-law target from the model-law target. These results establish the conditional correction and its scope, and the controlled experiments establish what happens when its magnitude is reallocated with learned estimates.
For the sampler, the practical conclusion is that rules which normalize, clamp or otherwise modify the guidance magnitude should be assessed for how they distribute the correction across samples, and not only for their average strength. The matched-budget protocol gives a concrete way to do this, including for estimators developed independently of ours.
2. Matched-budget experiment on class constraints
We ran the same matched-budget test on two semantic constraints, the CIFAR-10 classes cat and ship, judged by a separately trained classifier. The protocol is unchanged: the three rules use the same classifier gradient direction, and the equal and 1/ĥ rules give each sample a step whose mean is the standard rule's mean step at every t (1,000 samples per run; satisfaction % / FID_c).
The matched-budget effect extends to semantic class constraints. The equal step lowers satisfaction in all eight runs, with FID_c within 1.6 of the standard rule in seven of them. The effect is strongest on ship: at γ = 5 the loss is 8.5 and 8.2 points in the two sampling seeds, while FID_c changes by less than one point, and at γ = 10 it is 7.2 points. On cat it is 1.2 to 4.4 points, in the same direction in every run. The inverse-probability weighting recovers part of the loss in every run.
These results take the original observation beyond low-level image statistics. Together with two further pixel predicates, further guidance scales, coarser samplers, our own head, the Spectral Guidance estimator, the dependent conjunction and the molecular filter reported below, the comparison now spans 32 configurations, 30 on CIFAR-10 and 2 on QM9, against 6 in the submission, with lower satisfaction under the equal step in every one. The effect is thus not specific to the original predicates or to our head, and its size varies with the constraint.