- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies fit-aware virtual try-on, motivated by the observation that existing VTON systems can generate visually plausible clothing transfers while failing to reproduce how a specific garment should actually fit different body shapes. The proposed system, FitVTON, represents fit through a measurement-derived Garment-Body Size prompt and learns garment-body deformation from physics-based synthetic data rather than relying only on conventional appearance-oriented VTON supervision.
Critical strengths
- The paper addresses an important limitation of current virtual try-on systems: garment appearance transfer and image realism do not necessarily imply correct garment-body interaction. The proposed simulation pipeline provides controlled supervision over five garment sizes and 16 body prototypes, with multiple poses and wearing styles, producing 1,190,400 synthetic training triplets. Unlike standard paired VTON data, this construction allows the same garment design to be observed under systematically varied garment/body size relationships.
- FittingEffect3K and the four-dimensional fit evaluation protocol target garment-body alignment, tightness/looseness, silhouette, and local fitting artifacts rather than relying exclusively on FID/KID. FitVTON obtains the highest reported overall fit score in Table 1, is selected most often in the independent human preference study, and remains competitive on standard image-quality metrics.
Critical weaknesses
- FitVTON's inference procedure uses Garment-Body Size prompts generated from measurements of the person and garment. However, in the main baseline comparison, Section 4.2 states that competing approaches use their respective default prompts. This creates an important confound: part of FitVTON's advantage may arise from receiving explicit physical metadata that the competing methods do not receive in the main quantitative experiment.
- The claimed generality of garment-body fit control exceeds the diversity represented by the body and size model. FitVTON represents human morphology using only 16 body prototypes per gender, constructed from four height levels and four body-size levels. When garment measurements are unavailable, as in the in-the-wild evaluation, garments are simply treated as M-size; body-size levels are also visually estimated when tape measurements are unavailable.
Questions for authors
- Can the authors report a full FittingEffect3K comparison in which competing models receive the same body- and garment-related information available to FitVTON whenever their interfaces permit it—for example body category, height, garment size, or numerical measurements? The qualitative EXP0–EXP3 experiment in Figure 11 is useful, but a quantitative result across the benchmark would be substantially more convincing.
- What is the FittingEffect3K fit score before versus after Stage-II texture rectification? The current ablation shows a clear FID/KID improvement from texture rectification, but does not quantitatively demonstrate that fit control is preserved.
4 comments
Response to Reviewer KXnU (Part II)
W2: Diversity of the body/size model and in-the-wild assumptions.
A (W2): We sincerely thank the reviewer for this detailed comment. We agree that 16 prototypes per gender are a coarse discretization and view FitVTON as a practical first step toward controllable fit:
- Coarse body prototypes: Garments include ease, so visible fit shifts occur mainly across ease boundaries rather than fine local variations; finer 3D shape is also underdetermined from a single photo and basic tape measurements. Importantly, the 16 prototypes serve as simulation anchors rather than a restriction on test subjects: real bodies are mapped by physical measurements (Appendix A.6, Table 5) while individual contours enter directly via the person image . None of the FittingEffect3K participants is a synthetic prototype.
- Defaulting unmeasured garments to M-size: Size M is the neutral anchor fitted to the mean SMPL-X body (Appendix A.4). Even under a fixed M label, body conditioning drives meaningful fit adaptation: in Fig. 17 (Appendix D.6), the same M-size Dress A falls below the knee on a 160 cm subject (Person 3) and at mid-thigh on 176–179 cm subjects (Persons 6–7). Whenever e-commerce size charts are available, the exact garment size level follows directly from Table 6.
- Visually estimated body size: Visual estimation is used only for unconstrained in-the-wild demos (Appendix D.6, where reported height still determines the height level). All quantitative evaluations on FittingEffect3K strictly use tape-measured height, chest, waist, and hips.
We have added these points, along with the single-fabric simulation assumption, to a Limitations paragraph in Sec. 6.
Q2: FittingEffect3K fit score before vs. after Stage II texture rectification.
A (Q2): We thank the reviewer for this valuable comment. We have added this comparison across all 3,350 FittingEffect3K pairs in Appendix D.3 (Table 10 & Fig. 13):
Table R8. Fit scores before and after Stage II (Appendix D.3, Table 10).
| Stage / LoRA Mixing (Stage I / Stage II) | GB | T/L | SC | LF | Upper | Lower | Whole Fit |
|---|---|---|---|---|---|---|---|
| Before Stage II (1.0 / 0.0, Stage I only) | 3.21 | 2.83 | 2.80 | 3.40 | 3.26 | 2.83 | 3.04 |
| After Stage II (0.8 / 0.2, FitVTON default) | 3.18 | 2.76 | 2.80 | 3.42 | 3.22 | 2.99 | 3.08 |
Stage II texture rectification at our default 0.8/0.2 LoRA mixing ratio preserves—and slightly improves—overall fit score from 3.04 to 3.08 (paired difference +0.04, 95% participant-bootstrap CI [+0.01, +0.08]), while delivering the substantial FID/KID gains on VITON-HD (13.53 → 10.44) and DressCode (11.66 → 5.21) shown in Table 3. Appendix D.3 also sweeps higher Stage II weights (0.6/0.4 → 2.96, 0.4/0.6 → 2.38), showing why freezing text LoRA during Stage II and blending image LoRAs at 0.8/0.2 achieves both realism and preserved fit control.
Thanks for the additional results and clarifications. I will keep my weak accept rating.
Thank you for taking the time to review our rebuttal and for your continued support. We sincerely appreciate your time and effort throughout the review process.
Response to Reviewer KXnU (Part I)
We sincerely thank the reviewer for the thorough review and insightful feedback. We are encouraged that the reviewer recognizes the value of our simulation pipeline in providing systematic supervision across diverse garment-body size relationships and the effectiveness of FittingEffect3K and our fit-oriented evaluation protocol in assessing garment fitting quality. We have carefully considered all comments and hope the following clarifications address the reviewer's concerns.
Q1: Fair comparison when baselines receive body and garment metadata.
A (Q1): Thank you for raising this important point. Specialized mask-free VTON baselines use fixed task prompts (or lack text encoders, such as CatVTON) and were not trained on measurement metadata. To test whether explicit physical metadata explains FitVTON's advantage when interfaces support it, we added two quantitative evaluations:
1) Full FittingEffect3K benchmark (3,350 pairs) with body and garment metadata (Table 1, Appendix B). We evaluated the recent open-weight multi-image editor Qwen-Image-Edit-2511 on all 3,350 pairs, giving it the exact same height and body-size levels as FitVTON alongside garment size M. Even with this explicit metadata, Qwen-Image-Edit-2511 reaches 2.95 vs. FitVTON's 3.08 (Upper: 3.12 vs. 3.22, Lower: 2.80 vs. 2.99, Dress: 2.73 vs. 2.90).
2) 400-triplet controlled prompt sweep across four baselines (Appendix D.2, Table 9). Expanding Fig. 12 quantitatively, we evaluated Any2AnyTryOn, OmniTry, JCo-MVTON, and Nano Banana on 400 real try-on triplets across EXP0 (default), EXP1 (body shape, height category, garment size), EXP2 (numerical height, weight, garment length), and EXP3 (combined):
Table R7. Prompt-level sweep on 400 real try-on triplets (Appendix D.2, Table 9).
Providing body categories or numerical measurements slightly lowers fit scores for the three open-source VTON models (which ignore or are perturbed by out-of-distribution prompt tokens) and changes Nano Banana by at most +0.10 (2.89 → 2.99), still well below FitVTON (3.08). Hence, FitVTON's gains come from learning physical garment-body deformation in Stage I rather than from prompt metadata alone.