- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
LNR is a training-free inference-time steering method for diffusion models. It ranks Gaussian candidate noises using a shared reward direction, avoiding repeated neural scoring. For the single-winner rule, the paper derives a cubic asymptotic expression for local proxy regret relative to exact scoring of the same candidate pool and characterizes the noise distribution and its bounded density ratio. It also explains the relationship to matched mean-shift guidance. Experiments cover image generation, non-differentiable rewards and D4RL control.
Critical strengths
S1. The core method and local analysis are clearly explained. The linear approximation gives an intuitive reason for inexpensive ranking. The explicit regret coefficient, near-tie argument and noise decomposition offer useful insight, supported by the MNIST experiments.
S2. The 50-step single-winner experiment shows a useful reward–time trade-off. On the same GPU, LNR achieves PickScore 0.2294 in 11.5 seconds, compared with 0.2279 in 19.6 seconds for four-candidate SVDD-PM [1]. Direct winner sampling is a useful consequence of the noise law, and the paired interval and candidate-count sweep support this comparison.
S3. The evaluation includes SDXL, FLUX, black-box rewards, control and direction-refinement ablations. The authors acknowledge mixed held-out metrics, limited task-wise RL advantages and the scope of the single-winner theory.
Critical weaknesses
W1. Baseline validation is my main concern. LAGS [2] gives almost no improvement in Table 2 (0.2167 versus 0.2172 for the base model), and the separate 50-step comparison in C.5 says its original benchmark reproduction remains unverified. DOIT [3] is a JPEG outlier in Table 3: 102.31 KB, compared with 108.50 KB for the base model and 33.59–41.36 KB for the other guided methods. Both results merit validation under the changed reward and sampling protocols; they do not establish implementation errors.
W2. It is unclear how much of the broader practical gain comes from the selection distribution itself. Matched mean shift performs about as well as basic LNR, while stronger results often use aggregation and direction refinement. Some practical details also remain unclear, including signed aggregation and its normalization, the stochastic FLUX transition and the counting configuration.
W3. Uncertainty and inference costs are less well documented outside the primary comparison. Most image results lack uncertainty estimates, making small differences such as two-object accuracy of 0.818 versus 0.808 hard to assess. Table 4 reports RL standard deviations but not run or episode counts. Its averages of 81.2, 81.6 and 82.4 for DOIT, LNR and corrected LNR suggest competitive performance; the efficiency comparison remains unclear because their sampling and gradient budgets differ.
Questions for authors
Q1. Beyond the parameters in C.5, how were baseline configurations transferred and tuned, including reward transformations? Could you validate LAGS against its original SD/PickScore setup [2] and explain DOIT's limited JPEG improvement?
Q2. Could you clarify signed aggregation and normalization, the FLUX stochastic transition, and the RL selection and correction settings? Which counting configuration produced 0.700: M=2 in Section 5.2 or M=3 in Table 6? For Table 5, how do the timings relate to C.5 and the Table 3 results? Please explain the timed reward, hardware and dagger markers, and confirm whether LiDAR's matched budget refers to reward-query counts.
Q3. How does corrected LNR compare with mean shift using a comparable direction-refinement rule, mean displacement and gradient budget?
Q4. Beyond the paired interval in C.5, could you report uncertainty for the other main image comparisons, especially counting and two-object accuracy, and specify the RL run and evaluation-episode counts?
Q5. Could you report inference costs for Table 4 and compare RL returns across sampling budgets, including terminal best-of-N action selection for both LNR variants and representative baselines? DOIT's original evaluation uses this selection [3]. Comparing with unsteered best-of-N at similar total inference time would help show what stepwise steering adds.
Q6. C.3.2 reports that increasing M from 32 to 64 barely changes PickScore but lowers ImageReward from 0.785 to 0.421. How were settings chosen given this reward–quality trade-off, and how consistent is the decline across prompts and seeds?
I may raise my rating if these concerns are convincingly addressed.
References
[1] Xiner Li et al. Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-based Decoding. NeurIPS, 2025.
[2] Heasung Kim et al. Efficient Weighted Sampling via Score-based Generative Models. CVPR, 2026.
[3] Qijie Zhu et al. Training-Free Adaptation of Diffusion Models via Doob's h-Transform. ICML, 2026.