- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes W-DiT, a reference-guided fashion video generation model built on top of Wan2.2. To keep garment textures and logos from drifting across frames, it decomposes reference images into low- and high-frequency components using a 2D Haar wavelet transform, uses the low-frequency structure to find spatial correspondences across video frames, and explicitly injects the high-frequency features into the DiT to boost texture accuracy. The authors also curate FashionVideo, a synthetic dataset of 10,000 videos, to train and evaluate the model alongside tests on Fashion-Text2Video.
Critical strengths
Decoupling low-frequency structural alignment from high-frequency texture injection is a reasonable and intuitive approach to preserving garment details. The experimental validation is fairly comprehensive, including a clean controlled ablation against Wan2.2 in Table 3 and zero-shot evaluation on real videos in Fashion-Text2Video. The visual results also show clear improvements in keeping logos and patterns consistent compared to the baselines.
Critical weaknesses
- My major concern is that this paper is essentially engineering a complex frequency patch onto an older backbone (Wan2.2) to fix a problem that SOTA video models (like Veo, Kling, or Omini) largely solve natively through scale, better VAEs, and full-attention conditioning. In fact, the authors' own dataset pipeline proves this point: while they claim existing models fail to keep garment details consistent, Section 4.2 (Lines 283–285) reveals that all 10k GT target videos in FashionVideo are synthesized by Wan2.5 from static images and used to train Wan2.2. If wan2.5 already preserves details well enough to serve as ground truth, then modern video models already solve this task without wavelet branches; if not, then the training target is fundamentally flawed. For this reason, I'm afraid this paper adds little value to the research community.
- The key evaluation metric Detail Fidelity Score (DFS) is used throughout the paper to prove that the paper's method can better preserve fine texture details and logos. However, DFS is just a DINOv2 cosine similarity score, which measures coarse semantic/appearance similarity. The paper has not made it clear why this is a good metric to evaluate high frequency textures.
Questions for authors
- Can you compare W-DiT against Wan2.5 (which generated the training targets) and modern SOTA video models like Veo or Omini-style unified DiTs on the test sets?
- For the try-on video editing application, it seems that the pipeline only edits the initial image and re-generates the whole video sequence. How does this method preserve the motion sequence and the camera framing/trajectory of the original video? If all the input is an edited image, then calling it "video editing" is misleading. Please clarify.
Response to reviewer c6iM
[W1, Q1: Modern video models and training-data construction] FashionVideo uses human-screened Wan2.5 outputs. Candidates are retained only when they preserve garment details and facial identity and exhibit reasonable motion rather than remaining static. Only approximately 30% of Wan2.5-generated videos are usable under these criteria and pass dataset screening. Under the same criteria, W-DiT improves usability from 31% to 72% on 100 held-out reference-image and prompt pairs (Appendix B.1).
We extend the usability evaluation to Wan2.5, Veo 3, Omni, and Seedance 2.5, through their APIs on the same 100 held-out reference images and prompts and the joint criteria above:
W-DiT exceeds the highest-scoring tested general-purpose model, Seedance 2.5, by 27 percentage points and Wan2.5 by 41 percentage points. These results show that preserving garment details and identity while producing reasonable motion remains challenging for the tested modern generators. The human-screened Wan2.5 targets supply successful training examples, and W-DiT substantially improves the reliability of meeting these requirements on held-out inputs. The main FashionVideo comparison also includes Kling (Table 1).
[W2: Detail evaluation beyond DFS] We complement garment-level DFS with human assessments and motion-compensated measurements of local details.
Human evaluation. Appendix B.2 evaluates whether local logo/pattern shape is preserved, placement remains anchored to the garment, and details remain stable during movement. W-DiT vs. Wan2.2 achieves pass rates of 78% vs. 38%, 85% vs. 52%, and 76% vs. 34%, respectively. Overall pass rates are 73/100 vs. 29/100. A separate pairwise study measures perceived garment-texture fidelity. W-DiT is preferred in 76.5% of non-tied judgments (Appendix A.2). Across 200 video pairs, the Pearson correlation between DFS and human texture preferences is r = 0.74, indicating agreement between the automated metric and human judgments (Appendix A.3).
Motion-compensated evaluation. Appendix D.2 evaluates detail consistency during motion using two complementary metrics. Garment Ewarp ↓ measures mean squared RGB differences between adjacent frames after optical-flow alignment, restricted to valid, non-occluded garment regions. Trajectory-Aligned DFS ↑ measures DINOv2 feature cosine similarity between tracked garment points and their corresponding reference-image points, assessing local reference fidelity along visible trajectories. With one reference, W-DiT vs. Wan2.2 obtains 3.41 vs. 5.18 (×10⁻³) for Garment Ewarp and 81.6 vs. 70.3 for Trajectory-Aligned DFS.
[Q2: Try-on video editing inputs] W-DiT directly accepts the original reference image and textual edit instructions, without requiring a pre-edited image or an external image-editing stage. At evaluation, Qwen-Image-Edit is used to prepare target-outfit inputs for comparison with general-purpose video generators. Appendix C.1 clarifies this evaluation setting, and Appendix C.2 reports both W-DiT's original-image results and the additional shared-input control. The generated motion and camera behavior follow the prompt. Frame-by-frame preservation of a source video's motion or camera trajectory is outside this experimental setting. Taking your suggestion into account, we have renamed the application garment-edited video generation to clarify its scope.