- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
FusedVTON investigates whether virtual try-on requires garment representations separate from the person’s spatial token grid. It crops, resizes, and places reference garments into a clothing-agnostic person image before VAE encoding, then conditions an SD1.5 or FLUX.1 backbone on the fused image and DensePose. Multiple garments are jointly represented within the same canvas, keeping the denoiser’s spatial token count fixed. Experiments cover VITON-HD, DressCode, DressCode-MR, and Garments2Look, with quantitative comparisons, qualitative examples, and component ablations. The paper reports competitive quality and approximately 52–54% lower model-inference FLOPs than corresponding CatVTON variants under a separate profiling protocol.
Critical strengths
-
A simple and consequential conditioning design. Representing garments within the person’s existing spatial grid removes the need for separate garment branches or additional garment tokens. This provides a clear computational advantage, particularly when conditioning on multiple garments. The demonstrated reduction in model-inference cost makes the design a useful contribution to efficient virtual try-on.
-
Evidence across different backbones and try-on settings. The approach is instantiated with both SD1.5 and FLUX.1 and evaluated on four single- and multi-garment benchmarks. The fusion and placement ablations provide additional support for the proposed design choices. Together, these experiments suggest that early image fusion is a viable conditioning strategy beyond a single architecture or dataset.
Critical weaknesses
-
Heuristic placement and dependence on masks. The method relies on heuristic garment placement guided by clothing-agnostic masks and human parsing. Although Table 5 compares fusion spaces and placement strategies, robustness to inaccurate masks remains untested. How do missing regions, incorrect boundaries, or parsing errors affect placement and generation? Controlled perturbation experiments are needed. Furthermore, the current pipeline still requires mask-based preprocessing, and its applicability to mask-free methods is not established.
-
Incomplete efficiency evaluation. Since efficiency is a central contribution, FLOPs and latency alone provide an incomplete assessment. The paper should also report total inference parameters and peak GPU memory, together with preprocessing costs. Including compact diffusion and representative GAN-based baselines, such as Mobile-VTON and SD-VITON, under comparable settings would better establish the practical quality–efficiency trade-off.
-
Missing human evaluation. The paper does not include a user study. Aggregate image metrics cannot fully establish garment fidelity or perceptual realism, particularly for text, intricate textures, and densely composed outfits. A blinded comparison assessing garment similarity, person preservation, and overall realism would provide stronger evidence that the computational savings preserve perceptually important details.
-
Insufficient visualization of multi-garment inputs. Although joint generation is described, the paper should show the actual fused conditioning images used during training and inference for two, three, and four garments. These examples should illustrate area allocation, overlap resolution, and the effect of garment dropout during training. Packing multiple items into one canvas may produce crowded compositions or excessive shrinking; without inspecting these inputs, it is difficult to assess how much garment information survives preprocessing.
-
Limited quantitative validation at high resolution. The quantitative quality evaluation is restricted to 512 × 384, despite the availability of higher-resolution baselines and the paper’s own 1024 × 768 efficiency measurements and qualitative examples. Downsampling may obscure precisely the texture and detail losses introduced by fixed-canvas fusion. The authors should justify this choice and provide matched 1024 × 768 quality, latency, and memory comparisons to establish whether the reported trade-off persists at higher resolution.
Questions for authors
My questions are incorporated into the five points in Critical Weaknesses. Please respond to them individually. Clarifications concerning mask dependence, multi-garment input construction, and the evaluation resolution could materially affect my assessment.