- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a decoupled flow matching framework for measurement-guided virtual try-on. The method assigns fitting supervision from synthetic data to the high-noise stage and supervision from real images to the low-noise stage, connecting the two training stages via a structural bridging mechanism. Additionally, the paper introduces GSE, which maps the dimensional relationships between garments and the human body to image space to enable continuous fitting control. The authors also constructed a dataset with measurement annotations and proposed relative fitting metrics such as HFE and SFE to evaluate the accuracy of garment length. Experimental results in the paper demonstrate that this method achieves good performance in terms of fitting accuracy, controllability, and visual quality.
Critical strengths
1.The research question and motivation are fairly clear. The paper provides a relatively clear analysis of the respective strengths and limitations of real-world fitting data and synthetic data, laying a sound foundation for research into how to combine these two types of data to achieve controlled garment fit.
2.The experimental results and appendix provide relatively comprehensive information. The authors not only performed ablation studies on the main modules but also analyzed the segmentation timesteps and provided detailed explanations of data construction, handling of evaluation failures, and the setup for reproducing the baseline results.
Critical weaknesses
1.The technical innovation is limited. The three main contributions proposed in the paper are relatively straightforward: time-step-based synthetic/real supervised allocation and bridging, clothing-human scale encoding, and keypoint-based fitting metrics. Although these designs demonstrate some effectiveness, the overall technical approach is relatively simple, and the methodological innovation embodied by their combination remains limited.
2.The current experiments are insufficient to support some of the paper’s main claims. Although the experiments show that phased training outperforms directly mixing synthetic and real data, they have not directly demonstrated that synthetic data is better suited for early-stage global fitting, while real data is better suited for late-stage detail refinement. The absence of a reverse comparison (real-early versus synthetic-late) makes it difficult to determine whether the improvement stems from this specific division of responsibilities or simply from training the two data domains separately over time steps.
Questions for authors
1.Can the author provide more direct evidence to verify the division of labor proposed in the “flow trajectory”? For example, one could first use real data and then synthetic data, or analyze intermediate results from different time periods to verify whether the overall fit structure was indeed primarily formed in the early stages, while the specific details of the fit were mainly optimized in the later stages.
2.Quantitative Comparison of GSE. The appendix describes a controlled comparison between GSE, numerical conditioning, and prompt conditioning, but presents only qualitative results. Could the authors provide the corresponding HFE, SFE, and IoU results?
3.Since HFE and SFE are calculated based on keypoints detected by DeepFashion2 and MMPose, is the positioning of these keypoints on the generated images reliable enough? To what extent will positioning errors affect the final reported fitting score?
4 comments
Responses to Reviewer tCfE(Part2)
Q2: Validation of Stage-Specific Supervision Through Reverse Data Allocation and Intermediate results Visualization.
A2: We thank the reviewer for this insightful suggestion. To further validate the proposed division of labor along the flow trajectory, we provide two additional experiments:
1) Reverse Allocation. We reverse the supervision order by assigning real data to high-noise timesteps and synthetic data to low-noise timesteps. As shown in Table R5, FitFlow outperforms the reversed strategy across all seven metrics, supporting the effectiveness of the proposed synthetic-early/real-late allocation.This result has been incorporated into Table 2 of the revised manuscript.
Table R5. Quantitative comparison between reversed and proposed timestep supervision strategies. KID is reported in units of . Best results are highlighted in bold.
| Method | FID ↓ | KID ↓ | SSIM ↑ | LPIPS ↓ | HFE(%) ↓ | SFE(%) ↓ | IoU ↑ |
|---|---|---|---|---|---|---|---|
| Reverse Allocation | 15.419 | 1.982 | 0.8425 | 0.1225 | 7.71 | 8.40 | 0.8023 |
| FitFlow (Ours) | 13.930 | 0.516 | 0.8526 | 0.1152 | 5.54 | 5.86 | 0.8423 |
2) Intermediate Results Visualization. In Fig. 2, we have provided attention visualizations suggesting that early high-noise timesteps primarily shape macro geometry and body–garment alignment, whereas late low-noise timesteps focus on localized textures and wrinkles. To further clarify this observation and address the reviewer's concern, we additionally visualize intermediate sampling results at different timesteps. These results further illustrate the progression from overall garment structure to fine-grained appearance details during generation. We have included these visualizations as Fig. 16 in the revised manuscript. Together, these results provide both quantitative and qualitative evidence supporting our stage-specific supervision strategy and the proposed coarse-to-fine division of labor along the flow trajectory.
Q3: Quantitative Comparison of GSE with Numerical and Prompt Conditioning Using HFE, SFE, and IoU.
A3: We thank the reviewer for this careful comment. We would like to clarify that the quantitative results corresponding to the qualitative comparisons in the Appendix are already reported in Table 4 of the main manuscript, including HFE, SFE, and IoU.
Q4: Reliability of DeepFashion2 and MMPose Keypoint Detection and the Impact of Localization Errors on HFE and SFE.
A4: We sincerely thank the reviewer for this insightful comment. We acknowledge that keypoint localization errors may affect HFE and SFE. We would like to clarify our evaluation protocol from two aspects.
1) Keypoint Reliability. As described in Appendix A (Real-Data Curation) and Fig. 10(a), our real-world dataset undergoes manual inspection and filtering to ensure reliable human pose estimation, garment landmarks, and segmentation masks. Samples with missing or unreliable keypoints are removed during data curation. We have provided additional details on these filtering criteria in Appendix A of the revised manuscript.
2) Handling of Evaluation Failures. As detailed in Appendix B (HFE and SFE Qualification), we average multiple hem landmarks to reduce localization noise and evaluate both sleeves independently. Samples with unreliable keypoint detection are assigned the maximum fitting error of 100% rather than excluded. This transparent and consistent evaluation protocol avoids artificially optimistic scores, while evaluation over 2,000 test samples helps reduce the influence of individual localization errors on the aggregate results.
The reverse-allocation comparison addresses my main concern about the choice to use synthetic data early and real data late. I am raising my rating from 2 to 3. In the final version, please align the fit claims with the evidence and use manual annotations to check whether keypoint errors affect the HFE and SFE comparisons.
Thank You for Your Constructive Feedback
Dear Reviewer tCfE,
We sincerely thank you for your positive feedback and reconsideration of our work. We are glad that the reverse-allocation experiment helps address your main concern. In the final version, we will carefully refine our fit-related claims to better align with the experimental evidence and conduct manual annotation-based validation to assess the potential impact of keypoint estimation errors on HFE and SFE.
We greatly appreciate your constructive suggestions, which have helped us improve the paper.
Best wishes,
The Authors
Responses to Reviewer tCfE(Part1)
We sincerely thank the reviewer for the thorough review and insightful feedback. We are encouraged that the reviewer recognizes the sound foundation our work establishes for combining synthetic and real data to achieve controlled garment fit, as well as the simplicity and effectiveness of our framework. We have carefully considered all comments and hope the following clarifications address the reviewer’s concerns.
Q1: Concerns Regarding the Technical Contributions of Timestep-Based Supervision, Structural Bridging, Garment Size Encoding, and Keypoint-Based Fit Evaluation.
A1: We sincerely thank the reviewer for recognizing the importance of fit-aware VTON, as well as our comprehensive experimental analysis and promising results. To address the concern regarding methodological novelty, we further clarify our contributions from three perspectives.
1) Decoupled Flow Matching Framework. Although timestep-dependent training has been explored in prior work, FitFlow's key contribution lies in aligning the complementary characteristics of synthetic and real data with the coarse-to-fine generation process of Flow Matching, establishing a unified cross-domain training framework. To address potential structural inconsistencies arising from stage-specific supervision, we introduce the Structural Bridge to connect synthetic structural priors with real appearance supervision through a continuous training path. This mechanism goes beyond simple data allocation, requiring careful coordination of cross-domain supervision, timestep partitioning, and training path design. Its effectiveness is further validated by our ablation studies.
2) Garment Size Encoding (GSE). Incorporating physical garment measurements into VTON remains challenging. Unlike FIT's Numerical Embedding and FitVTON's Text Embedding, GSE leverages the garment-length-to-body-height ratio to proportionally scale the entire garment within a canonical grid, providing simple, efficient, and geometrically interpretable size control. As also acknowledged by Reviewer BYF2 in Critical Strengths, GSE offers "Simple and effective conditioning for body-relative garment scale." and “Its simplicity makes it a useful contribution to measurement-guided garment placement.”
3) Fit-Aware VTON Benchmark and Evaluation. Existing datasets, such as DressCode and VITON-HD, lack explicit body and garment measurements. To address this limitation, we construct a real-world try-on benchmark with measurement annotations. Furthermore, conventional metrics (FID, KID, SSIM, and LPIPS) cannot directly assess garment fit. We therefore introduce HFE and SFE to provide more direct quantitative evaluation of size-aware garment placement.
Overall, FitFlow's contributions extend beyond individual components to the unified development of cross-domain complementary supervision, geometric size encoding, and a dedicated benchmark and evaluation protocol for fit-aware VTON. We hope these clarifications help the reviewer better appreciate the novelty and broader contributions of our work and respectfully invite the reviewer to reconsider their assessment.