- Rating
- 3
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DirectTryOn, a two-stage framework for efficient one-step virtual try-on. The authors argue that, unlike general image generation, virtual try-on is strongly constrained by person and garment inputs, resulting in lower conditional uncertainty and potentially straighter transport trajectories. Based on this observation, the first stage fine-tunes a pretrained flow-matching model through pure conditional transport, garment preservation loss, and self-consistency loss to encourage straighter conditional trajectories. The second stage employs Latent Adversarial Diffusion Distillation to obtain a one-step student model. Experiments on VITON-HD and DressCode demonstrate strong image generation quality, with the best FID and KID scores among the evaluated baselines. DirectTryOn achieves approximately 19× faster end-to-end inference than the fastest evaluated multi-step baseline. The authors also provide ablation studies to validate the effectiveness of the proposed training components.
Critical strengths
-
Clear motivation: The paper identifies an important limitation of existing diffusion-based virtual try-on methods: their reliance on computationally expensive multi-step sampling. The observation that strongly conditioned VTON tasks may admit straighter transport trajectories provides an interesting perspective on one-step generation.
-
Reasonable framework design: DirectTryOn combines conditional transport straightening with one-step distillation. The garment preservation and self-consistency objectives are intuitively motivated and designed to address garment fidelity and trajectory consistency.
-
Promising empirical results: The method achieves strong quantitative and qualitative performance on VITON-HD and DressCode while substantially reducing inference time. The component-wise ablations, loss sensitivity analyses, and comparisons with generic acceleration methods provide useful evidence of its effectiveness.
Critical weaknesses
-
W1. Insufficient validation of the theoretical motivation: The paper argues that VTON has lower conditional uncertainty and therefore straighter transport trajectories, making one-step generation more feasible. However, the experiments mainly provide indirect evidence through FID improvements. A more direct analysis of trajectory curvature and its relationship with generation quality would better support this central claim.
-
W2. Limited analysis of sampling efficiency: Although the paper focuses on one-step generation and provides some comparisons with 4-step and 30-step sampling, the trade-off between generation quality and sampling efficiency remains unclear. A more systematic evaluation across different sampling steps would help justify the choice of one-step generation.
-
W3. High training costs and limited generalization: The method requires substantial training resources, including lengthy fine-tuning and an additional distillation stage. Moreover, separate models are trained for VITON-HD and DressCode, leaving cross-dataset generalization unclear. Evaluations on more challenging real-world benchmarks, such as StreetTryOn, would further strengthen the paper.
Questions for authors
-
Q1. Could the authors directly measure the transport trajectory curvature before and after the proposed straightening stage? It would be helpful to analyze whether straighter trajectories consistently lead to better one-step generation quality.
-
Q2. Could the authors provide a more systematic comparison across different sampling steps (e.g., 1, 2, 4, 5, and 10), including both generation quality and inference time? This would help clarify whether one-step generation offers the best quality–efficiency trade-off.
-
Q3. Could the authors evaluate cross-dataset generalization, such as training on VITON-HD and directly testing on DressCode without additional fine-tuning? Additional evaluations on more challenging benchmarks, such as StreetTryOn, would also be valuable.
-
Q4. Given the substantial training costs, could the authors further discuss whether similar one-step performance can be achieved with fewer fine-tuning epochs or reduced training resources?
3 comments
Thank you for the additional experiments and clarifications. Regarding Q3, could you clarify whether the model trained on VITON-HD was evaluated on the full DressCode test set without additional fine-tuning? The response mainly presents qualitative results; quantitative results would provide stronger evidence of generalization. Overall, I appreciate the framework design and its improvements in generation quality and inference efficiency.
Thank you for your positive assessment of our work and for recognizing the merits of our framework, particularly its improvements in generation quality and inference efficiency.
To clarify, the model trained on VITON-HD was evaluated on DressCode without any additional fine-tuning. Following your suggestion, we have added quantitative evaluation results and a comprehensive analysis of cross-dataset generalization in Appendix K.
We sincerely appreciate your valuable suggestion, which has helped us further strengthen our experimental evaluation.
Thank you for your review and constructive suggestions. We address your questions and concerns point by point below.
1. Direct trajectory analysis and one-step quality
Sec. 4.4 and Table 2 now measure actual model-generated ODE trajectories before distillation. SD3 Base uses 160 randomly selected text prompts, while Standard FT and PCT+GL+SC perform try-on on VITON-HD. Compared with SD3 Base, even Standard FT reduces velocity variance from 15,578.17 to 6,699.10 (57.0%) and one-/30-step latent deviation from 239.96 to 67.93 (71.7%), supporting our motivation that try-on admits straighter conditional transport.
At the same 100-epoch budget, PCT+GL+SC further reduces orthogonal deviation from 12.6219 to 12.0997 and one-/30-step latent deviation from 67.93 to 57.10 (15.9%), with lower velocity variance. The path length ratio is unchanged between the two fine-tuned models. Together with the generation-quality ablations (Sec. 4.3; Appendix C, Table 4), these results support the connection between improved trajectory consistency and one-step generation quality.
2. Quality–efficiency trade-off across sampling steps
We evaluated the straightened teacher on VITON-HD with 1, 2, 4, and 10 steps. We also include the final distilled student (Table 1):
More teacher steps improve quality at higher latency. Distillation brings one-step quality close to the four-step teacher while reducing latency by 2.1×. This supports one-step generation as an efficient operating point, while additional teacher steps remain useful when quality takes priority.
3. Cross-dataset and in-the-wild generalization
Appendix K, Fig. 8 provides results from the VITON-HD-trained one-step model applied directly to DressCode and StreetTryOn person images, without further fine-tuning.
4. Training cost and fewer fine-tuning epochs
As discussed in Secs. 1 and 3.3, we rely on a pretrained base model for priors on how garments appear on people. However, general-purpose pretraining learns much broader content and does not explicitly encourage VTON's near-straight denoising trajectories. We view this mismatch as a major reason for the extended fine-tuning needed to adapt the model.
A promising direction is to pretrain a smaller base model from scratch specifically on clothed people, then fine-tune it for try-on. We expect this more focused prior to enable faster convergence during adaptation, while the smaller model could reduce fine-tuning and inference costs. This remains a direction for future work.