- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a training-free sampler for coarse-guided visual generation. It approximates an ideal h-transform using a coarse reference and adjusts guidance through a noise-dependent schedule and a cross-timestep consistency correction. Experiments cover image restoration, camera-controlled video generation, and additional editing applications.
Critical strengths
-
The method is simple and broadly applicable, requiring neither additional training nor an explicit degradation operator. The formulation supports both diffusion and flow-matching models.
-
The experiments demonstrate competitive image restoration performance and improvements in video quality. Table 2 reports better FVD and DINO distance than both the coarse input and the evaluated generation baselines.
Critical weaknesses
-
The video evaluation protocol needs clarification. Section 6.2 defines generation from a first frame and prescribed camera poses. However, Appendix A.4.1 describes calibrating depth scale through SIFT matches between the reference frame and subsequent frames. If these are ground-truth target frames, preprocessing uses information unavailable under the stated task setting. Sharing the resulting coarse videos with a baseline would not resolve this mismatch between the evaluation protocol and the intended application.
-
The central adaptive contribution is insufficiently validated. The practical formulation blends the model prediction with the coarse reference, making the weighting strategy central to Table 3 shows improvements over the fixed noise-dependent schedule, but these are relatively modest, and the adaptive correction is disabled in the video experiments. The consistency residual is not directly validated as a proxy for endpoint error. Furthermore, the additional model evaluations required by the correction are not accompanied by a clear runtime or equal-compute comparison.
Questions for authors
-
Which frames are used for SIFT-based scale calibration in Appendix A.4.1? If ground-truth target frames are used, how does performance change when preprocessing uses only the first frame and prescribed camera poses?
-
What are the model-evaluation count and runtime overhead of the adaptive correction? Can the authors provide an equal-compute comparison against the fixed noise-dependent schedule to establish whether the gains justify this overhead?