- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
φ-Noise is a training-free way to condition a video diffusion model on a reference video by editing only the initial noise. Noise and reference latent are transformed with a DFT, the k lowest-frequency phases of the noise are replaced with the reference, and a mask scales the low band by 1/γ and the rest by β so that total energy is unchanged. The temporal DFT serves image-to-video motion transfer and cut-and-drag; the spatial DFT serves text-to-video motion transfer and image generation. Results are reported on Wan2.2-14B over a 60-video suite, with qualitative transfers to LTX-2 and SDXL.
Critical strengths
- The method costs one FFT on the initial noise, with no training, inversion, attention surgery or test-time optimisation, and no added latency. Every baseline compared against is more expensive.
- The presented method is generally useful: three tasks, two video backbones and an image model, with spatial and temporal conditioning in one formulation.
- The text-to-video result is strong where it matters most for a noise-space method. Among the motion-transfer baselines in Table 1, φ-Noise has the best imaging quality, subject consistency, smoothness and LPIPS-T, and the second-best flow error. The competitors all degrade base-model quality markedly; φ-Noise does not. Reporting the unconditioned Wan rows is the right control, and it carries that claim within a fixed backbone.
Critical weaknesses
- No variance on a 60-video suite, and k may be tuned per video.
- The mechanism is observed rather than explained, and two of its descriptions are the wrong way round.
Questions for authors
- Are k and γ chosen per video? If so, by what criterion, and what does Table 1 look like with one fixed setting per task?
- Can you report variance over seeds for Table 1, and quantitative image-to-video results against MotionClone?
- Does phase specifically matter? How does replacing the full low-frequency band, magnitude and phase, under the same Φ compare with phase-only substitution?
- For clarification: is the DFT in Eqs. 3, 8 and 9 one-sided or two-sided? As written, substituting for f ≤ k over indices 0…t−1 would break conjugate symmetry, which a one-sided implementation handles automatically.
Response to Reviewer 8GF4
Dear reviewer 8GF4,
We thank the you for the detailed and constructive evaluation, particularly for recognizing the computational simplicity, broad applicability, and strong text-to-video performance of -Noise. We appreciate the observation that our approach maintains favorable image quality and temporal consistency while achieving competitive motion alignment.
We agree that the main remaining questions concern the robustness of the results and the precise interpretation of the frequency-domain mechanism.
We address some concerns shared with other reviewers in a message above meant for all reviewers: Hyperparameter selection and robustness, I2V quantitative comparisons, and the benefit of using phase only for conditioning.
Variance Across Seeds
We report variance across seeds in the following table:
We note that as each example uses a different seed the variance is calculated over all examples.
DFT Formulation and Conjugate Symmetry
Thank you for identifying this important mathematical detail. We agree that real-valued noise requires conjugate-symmetric frequency coefficients for a real-valued inverse transform.
In our implementation, we use the real FFT (rFFT), which operates on the non-redundant, one-sided frequency spectrum (such that K=⌊T/2⌋+1), followed by the corresponding inverse transform (irFFT). Phase substitution is performed on this one-sided representation, and conjugate symmetry is implicitly handled by the inverse transform, ensuring real-valued reconstructed noise. Thus, our implementation avoids the conjugate-symmetry issue raised by the reviewer.
We will revise Eqs. 3, 8, and 9 to make the one-sided frequency indexing and symmetry treatment explicit, resolving the ambiguity in the current notation.
We will also revisit the mechanistic descriptions to distinguish what is directly demonstrated by the experiments from the intuition motivating our design.
We appreciate these detailed suggestions. We believe that clarifying the implementation and providing additional hyperparameter and multi-seed evaluations will strengthen the evidence for the method's robustness.
We welcome further discussion and any additional suggestions or clarifications you might have for our work.