- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
FlowVVTON is a mask-free video try-on framework built on an SD1.5 dual-UNet backbone. A frozen reference UNet injects garment features via mutual self-attention, and newly inserted temporal attention layers are trained with a flow-warped latent loss computed on decoder features. Training proceeds in two stages on pseudo-paired TikTokDress data, and flow is discarded at inference.
Critical strengths
- Optical flow is training-time only, which keeps deployment simple.
Critical weaknesses
- Limited novelty. Flow-warped feature consistency losses are long established in video generation and video translation, and flow-based temporal supervision has existed in video try-on since FW-GAN and ClothFormer, both already cited in Section 2.2. The contribution reduces to applying a known loss at several decoder levels with multiple strides. Section 2.2 also mischaracterizes this prior work: FW-GAN and ClothFormer explicitly estimate and exploit flow rather than applying post-hoc smoothing, and ViViD and Tunnel Try-on are SD1.5 plus temporal-module methods, not SVD-based. (RealVVT is genuinely SVD-initialized; the blanket attribution in Section 2.2 should be corrected to apply only to it.)
- Mask dependency is displaced, not eliminated. Section 3.2 never names the off-the-shelf model that synthesizes source-side videos. If it is mask-based, the pipeline inherits precisely the mask-based teacher dependency criticized in Section 2.3, and the pseudo-pair construction then closely resembles PEMF-VTO, which builds its paired pseudo-data with the mask-based ViViD.
- Non-standard and unfair evaluation. On TikTokDress, CatV2TON and MagicTryOn are evaluated from released checkpoints without fine-tuning while the proposed model is trained in-domain; on ViViD the bias reverses, since training on TikTokDress and testing on ViViD is not an accepted protocol. VVT and the standard ViViD training split are missing.
- Missing representative baselines. No mask-free video baseline is compared, which is the central claim. ViViD, Tunnel Try-on, WildVidFit, RealVVT, PEMF-VTO and TripVVT are all cited in Section 2 yet never evaluated; PEMF-VTO in particular is the closest mask-free competitor.
- Gains are not attributable to the claimed contribution. Table 4 shows that removing L_flow still yields U-VFID-R of 1.24 against SwiftTry's 3.42, i.e. about 2.8x of the headline 5.7x gap is already obtained without the proposed loss, so most of it originates from the undisclosed pretrained mask-free image base model. The large VFID-R movement alongside a 4% change in VFID-I is unexplained and suggests dominance by low-level appearance copying, consistent with the admitted sleeve-length failure.
- Technical inconsistencies. The abstract and Figure 2 claim all layers whereas Section 3.3 restricts the loss to decoder levels. Eq. 2 warps frame t+1 with F_{t+1->t} under W(F,f)(p)=F(p+f(p)), which requires the forward field F_{t->t+1}. Flow magnitudes must be rescaled when downsampled per layer, and tau is given without resolution normalization. The main text states noise-prediction MSE while the appendix states v-prediction.
- Incomplete analysis. The clean t=0 forward pass is off the denoising trajectory and doubles compute, yet is neither justified nor ablated. No sensitivity study for lambda, level weights, or joint versus two-stage training. Ablation gaps of 0.04 VFID-I lack seeds or variance, and only 13 raters participated.
Questions for authors
See above.
We thank the reviewer for the detailed assessment.
1. Novelty and related work.
Our contribution concerns where and how flow supervision is applied. FW-GAN, ClothFormer, and MV-TON exploit flow through generation, tracking, or refinement. We impose multi-resolution, confidence-weighted, multi-stride consistency on internal UNet features during video diffusion training (Sec. 3.1, Eqs. (2)–(3)). Flow supervises the trainable temporal modules and is discarded at inference. We will correct Sec. 2.2's descriptions of prior flow-based methods and distinguish SD1.5-based temporal-module architectures from SVD-initialized models.
2. Scope of mask independence.
The image backbone is DS-VTON; SwiftTry generates synthetic source-side videos (Sec. 3.2). Offline data construction therefore depends on a mask-based model, as in PEMF-VTO. Our mask-free claim concerns FlowVVTON's conditioning and deployment: it receives source frames and a garment image without mask or pose inputs, and does not require SwiftTry, mask estimation, or optical flow at inference.
We will remove “eliminates masks entirely” from Sec. 2.3. Synthetic videos are inputs and original videos are targets; Appendix A's contrary statement will be corrected.
3. Evaluation protocol and cross-dataset generalization.
The SwiftTry checkpoint in Table 2 also undergoes Stage 2 training on TikTokDress. Both are therefore trained in-domain, although backbones and data construction differ. Table 4 isolates the loss's incremental benefit.
Table 3 evaluates transfer from TikTokDress to ViViD. Such evaluation has precedent: PEMF-VTO trains on VITON-HD, DressCode, and ViViD, and evaluates on VVT and TikTok (Sec. IV-A, Table I). Our ViViD experiment similarly assesses generalization without dataset-specific fine-tuning.
CatV2TON and MagicTryOn use public checkpoints trained with ViViD data. We will clarify these training domains and label Table 3 as cross-dataset evaluation for FlowVVTON. VVT and in-domain ViViD training remain outside our evaluation.
4. Missing baselines.
Runnable implementations and pretrained checkpoints for PEMF-VTO and TripVVT were unavailable at submission and remain unavailable as of this rebuttal. PEMF-VTO's official repository contains only a README; TripVVT explicitly excludes training code, inference code, and checkpoints from its public release. This constrained reproducible comparisons. We acknowledge PEMF-VTO as a close comparator and TripVVT as a relevant baseline, and claim no superiority over unevaluated methods. We will clarify the release status and incomplete baseline coverage.
5. Attribution and interpretation of VFID improvements.
With the backbone, synthetic data, and temporal architecture retained, adding Lflow improves U-VFID-I/R from 32.48/1.24 to 30.99/0.60 (Table 4):
\quad \frac{1.24-0.60}{1.24}\times100\\%\approx51.6\\%.$$ Both metrics use spatiotemporal features; their relative changes neither establish appearance copying nor strictly separate spatial and temporal effects. **Both improve**, supporting the loss's additional benefit. Supplementary videos provide complementary qualitative evidence. We will distinguish this gain from the full $5.7\times$ gap to SwiftTry. **6. Technical consistency.** Features are captured from down, mid, and up blocks; “all layers” and decoder-only descriptions will be replaced by the precise supervised block set. With backward flow $b_l=F_{t+1\to t,l}$ and $\mathcal{W}(z,b)(p)=z(p+b(p))$, the discrepancy is: $$\left\|z_l(t+1,p)-\mathcal{W}\left(z_l(t),b_l\right)(p)\right\|_2^2.$$ **Eq. (2)** and **Appendix A's algorithm** will be corrected accordingly. Resizing scales displacements as $u_l=(W_l/W)u$ and $v_l=(H_l/H)v$. Confidence is computed at the training-image resolution with $\tau=3$ pixels, then resized to feature grids. The supplied zero-SNR configuration uses $v$-prediction; we will correct the main-text objective. **7. Clean-feature supervision and analysis scope.** Flow is estimated from clean frames. The clean branch at diffusion timestep $0$ avoids directly aligning independently sampled noise, which generally does not follow the estimated motion. This motivates the design without asserting exact feature equivariance or that noisy-feature supervision necessarily harms denoising. The extra forward and associated backward computation occur **only during training**, with **zero additional inference cost**. Table 4 demonstrates effectiveness at the evaluated setting; $\lambda=1$ was selected empirically. Sensitivity and training-strategy studies would further characterize its operating range. We will avoid treating the **0.04 VFID-I difference** as statistically reliable and present the **13-rater study** as supplementary evidence.