- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Uncertainty-guided Trajectory Steering (UTS), a training-free method for correcting hallucinations in diffusion-generated images. The method estimates uncertainty in the posterior mean predictor using multiple noisy samples and identifies steering directions through PCA. These directions are then used to steer the denoising trajectory toward nearby realistic modes. The evaluation is conducted on MNIST, synthetic shapes, hands, and a limited text-to-image setting.
Critical strengths
-
Clear presentation. The paper is well written and easy to follow, with an intuitive motivation and a straightforward algorithm.
-
Practical applicability. The proposed method is training-free and does not require backpropagation or external supervision. Its simplicity and ease of implementation potentially offer practical value for correcting hallucinations in pretrained diffusion models.
Critical weaknesses
-
Insufficient justification of the uncertainty formulation and PCA-based steering. The paper attributes uncertainty to two fundamentally different sources: mode interpolation and the denoising process. However, this distinction is neither sufficiently justified nor theoretically analyzed, and heavily corrupted inputs do not necessarily lead to high-variance outputs. Also, the PCA-based mode directions may not be suitable for resolving mode interpolation when clean predictions exhibit a superposition of multiple plausible modes (e.g., duplicated fingers or overlapping motions), as can occur in practice.
-
Limited experimental evaluation and comparison with related methods. The experimental evaluation is primarily conducted on small-scale datasets, with only a limited text-to-image setting. More comprehensive experiments on modern text-to-image or text-to-video diffusion models are needed to demonstrate practical applicability. Furthermore, the proposed method shares similar motivations and approaches with existing inference-time guidance methods, particularly Tangential Amplifying Guidance (Cho et al., ICML 2026). Without comparisons against closely related methods, it is difficult to assess the novelty and relative effectiveness of the proposed approach.
Questions for authors
-
Uncertainty formulation. What theoretical or empirical evidence supports separating uncertainty into mode interpolation and the intrinsic denoising process? In particular, why should heavily corrupted inputs necessarily produce higher variance in the posterior mean predictions?
-
Effectiveness of PCA-based mode directions. When a intermediate, clean x0 prediction exhibits a superposition of multiple plausible modes (e.g., duplicated fingers or overlapping motions, as discussed in DiffusionBrowser (Hong et al., 2025)), can the leading principal component effectively identify the competing modes and guide the prediction toward a single realistic mode? Could the authors provide additional analysis or experiments on such cases?
-
Comparison with related guidance methods. How does the proposed method differ from Tangential Amplifying Guidance (Cho et al., ICML 2026), which shares similar motivations and approaches? How does UTS compare empirically with other inference-time unconditional guidance methods, such as SAG (Hong et al., ICCV 2023), PAG (Ahn et al., ECCV 2024), ICG (Sadat et al., ICLR 2025), AG (Karras et al., NeurIPS 2024), and SEG (Hong, NeurIPS 2024)? Such comparisons would help clarify the novelty and effectiveness of the proposed method.
-
Scalability to practical settings. Can the authors provide more comprehensive evaluations on modern text-to-image or text-to-video diffusion models to demonstrate the scalability and practical applicability of the proposed approach?